2023-09-23 01:01:46,453 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-23 01:01:46,667 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40 2023-09-23 01:01:46,667 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-23 01:01:46,667 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-23 01:01:46,708 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-23 01:01:46,975 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-23 01:01:46,975 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24, deleteOnExit=true 2023-09-23 01:01:46,976 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-23 01:01:46,976 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/test.cache.data in system properties and HBase conf 2023-09-23 01:01:46,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 01:01:46,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop.log.dir in system properties and HBase conf 2023-09-23 01:01:46,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 01:01:46,979 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 01:01:46,979 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 01:01:47,305 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-23 01:01:47,310 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 01:01:47,310 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 01:01:47,311 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 01:01:47,311 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 01:01:47,311 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 01:01:47,312 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 01:01:47,312 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 01:01:47,312 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 01:01:47,313 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 01:01:47,313 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/nfs.dump.dir in system properties and HBase conf 2023-09-23 01:01:47,314 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir in system properties and HBase conf 2023-09-23 01:01:47,314 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 01:01:47,314 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 01:01:47,315 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-23 01:01:47,835 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 01:01:47,840 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 01:01:48,135 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-23 01:01:48,325 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-23 01:01:48,338 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:48,376 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:48,414 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_localhost_41289_hdfs____.nngdvk/webapp 2023-09-23 01:01:48,561 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41289 2023-09-23 01:01:48,601 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-23 01:01:48,602 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-23 01:01:49,063 WARN [Listener at localhost/36407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 01:01:49,132 WARN [Listener at localhost/36407] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 01:01:49,152 WARN [Listener at localhost/36407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:49,159 INFO [Listener at localhost/36407] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:49,168 INFO [Listener at localhost/36407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_localhost_36211_datanode____.n90o3u/webapp 2023-09-23 01:01:49,281 INFO [Listener at localhost/36407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36211 2023-09-23 01:01:49,753 WARN [Listener at localhost/45773] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 01:01:49,769 WARN [Listener at localhost/45773] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 01:01:49,773 WARN [Listener at localhost/45773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:49,776 INFO [Listener at localhost/45773] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:49,785 INFO [Listener at localhost/45773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_localhost_36117_datanode____.69kjt1/webapp 2023-09-23 01:01:49,926 INFO [Listener at localhost/45773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36117 2023-09-23 01:01:49,937 WARN [Listener at localhost/35641] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 01:01:49,952 WARN [Listener at localhost/35641] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-23 01:01:49,957 WARN [Listener at localhost/35641] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:49,958 INFO [Listener at localhost/35641] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:49,964 INFO [Listener at localhost/35641] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_localhost_45689_datanode____9yfybh/webapp 2023-09-23 01:01:50,113 INFO [Listener at localhost/35641] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45689 2023-09-23 01:01:50,145 WARN [Listener at localhost/46467] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-23 01:01:50,343 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbdb4e2c8def2c29e: Processing first storage report for DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d from datanode 1c4827ef-7805-4dae-93d5-79b7ade8b030 2023-09-23 01:01:50,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbdb4e2c8def2c29e: from storage DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d node DatanodeRegistration(127.0.0.1:40997, datanodeUuid=1c4827ef-7805-4dae-93d5-79b7ade8b030, infoPort=37021, infoSecurePort=0, ipcPort=35641, storageInfo=lv=-57;cid=testClusterID;nsid=550605553;c=1695430907920), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-23 01:01:50,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d939379724b4fbb: Processing first storage report for DS-ef615322-02c7-4587-92c9-dd6702dc13b6 from datanode 24852377-b8eb-47e9-a463-58ccc32708a2 2023-09-23 01:01:50,346 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d939379724b4fbb: from storage DS-ef615322-02c7-4587-92c9-dd6702dc13b6 node DatanodeRegistration(127.0.0.1:41165, datanodeUuid=24852377-b8eb-47e9-a463-58ccc32708a2, infoPort=34137, infoSecurePort=0, ipcPort=46467, storageInfo=lv=-57;cid=testClusterID;nsid=550605553;c=1695430907920), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 01:01:50,346 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3cde53655873b34: Processing first storage report for DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb from datanode 2a2003a1-fd9e-46f8-86e1-a18360bbc147 2023-09-23 01:01:50,347 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3cde53655873b34: from storage DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb node DatanodeRegistration(127.0.0.1:34891, datanodeUuid=2a2003a1-fd9e-46f8-86e1-a18360bbc147, infoPort=42005, infoSecurePort=0, ipcPort=45773, storageInfo=lv=-57;cid=testClusterID;nsid=550605553;c=1695430907920), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 01:01:50,347 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbdb4e2c8def2c29e: Processing first storage report for DS-791163d5-a226-4024-919f-184260e28431 from datanode 1c4827ef-7805-4dae-93d5-79b7ade8b030 2023-09-23 01:01:50,347 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbdb4e2c8def2c29e: from storage DS-791163d5-a226-4024-919f-184260e28431 node DatanodeRegistration(127.0.0.1:40997, datanodeUuid=1c4827ef-7805-4dae-93d5-79b7ade8b030, infoPort=37021, infoSecurePort=0, ipcPort=35641, storageInfo=lv=-57;cid=testClusterID;nsid=550605553;c=1695430907920), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 01:01:50,347 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5d939379724b4fbb: Processing first storage report for DS-795c0249-63ca-4b46-8949-b88ea4c526c1 from datanode 24852377-b8eb-47e9-a463-58ccc32708a2 2023-09-23 01:01:50,348 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5d939379724b4fbb: from storage DS-795c0249-63ca-4b46-8949-b88ea4c526c1 node DatanodeRegistration(127.0.0.1:41165, datanodeUuid=24852377-b8eb-47e9-a463-58ccc32708a2, infoPort=34137, infoSecurePort=0, ipcPort=46467, storageInfo=lv=-57;cid=testClusterID;nsid=550605553;c=1695430907920), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 01:01:50,348 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb3cde53655873b34: Processing first storage report for DS-ea4d4fea-0341-4c07-bb92-27ec3ad57b6f from datanode 2a2003a1-fd9e-46f8-86e1-a18360bbc147 2023-09-23 01:01:50,348 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb3cde53655873b34: from storage DS-ea4d4fea-0341-4c07-bb92-27ec3ad57b6f node DatanodeRegistration(127.0.0.1:34891, datanodeUuid=2a2003a1-fd9e-46f8-86e1-a18360bbc147, infoPort=42005, infoSecurePort=0, ipcPort=45773, storageInfo=lv=-57;cid=testClusterID;nsid=550605553;c=1695430907920), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-23 01:01:50,632 DEBUG [Listener at localhost/46467] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40 2023-09-23 01:01:50,719 INFO [Listener at localhost/46467] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/zookeeper_0, clientPort=64606, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-23 01:01:50,738 INFO [Listener at localhost/46467] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64606 2023-09-23 01:01:50,749 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:50,751 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:51,456 INFO [Listener at localhost/46467] util.FSUtils(471): Created version file at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b with version=8 2023-09-23 01:01:51,457 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/hbase-staging 2023-09-23 01:01:51,796 INFO [Listener at localhost/46467] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-23 01:01:52,245 INFO [Listener at localhost/46467] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 01:01:52,278 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,278 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,278 INFO [Listener at localhost/46467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 01:01:52,279 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,279 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 01:01:52,422 INFO [Listener at localhost/46467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 01:01:52,498 DEBUG [Listener at localhost/46467] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-23 01:01:52,591 INFO [Listener at localhost/46467] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42795 2023-09-23 01:01:52,604 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,607 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,630 INFO [Listener at localhost/46467] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42795 connecting to ZooKeeper ensemble=127.0.0.1:64606 2023-09-23 01:01:52,686 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:427950x0, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 01:01:52,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42795-0x100d64dda910000 connected 2023-09-23 01:01:52,723 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 01:01:52,723 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:01:52,737 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 01:01:52,745 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42795 2023-09-23 01:01:52,747 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42795 2023-09-23 01:01:52,747 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42795 2023-09-23 01:01:52,748 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42795 2023-09-23 01:01:52,749 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42795 2023-09-23 01:01:52,755 INFO [Listener at localhost/46467] master.HMaster(444): hbase.rootdir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, hbase.cluster.distributed=false 2023-09-23 01:01:52,822 INFO [Listener at localhost/46467] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 01:01:52,823 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,823 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,823 INFO [Listener at localhost/46467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 01:01:52,823 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,823 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 01:01:52,828 INFO [Listener at localhost/46467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 01:01:52,832 INFO [Listener at localhost/46467] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35139 2023-09-23 01:01:52,835 INFO [Listener at localhost/46467] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 01:01:52,842 INFO [Listener at localhost/46467] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 01:01:52,843 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,845 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,848 INFO [Listener at localhost/46467] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35139 connecting to ZooKeeper ensemble=127.0.0.1:64606 2023-09-23 01:01:52,852 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:351390x0, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 01:01:52,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35139-0x100d64dda910001 connected 2023-09-23 01:01:52,853 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 01:01:52,854 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:01:52,856 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 01:01:52,857 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35139 2023-09-23 01:01:52,857 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35139 2023-09-23 01:01:52,857 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35139 2023-09-23 01:01:52,858 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35139 2023-09-23 01:01:52,858 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35139 2023-09-23 01:01:52,871 INFO [Listener at localhost/46467] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 01:01:52,872 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,872 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,873 INFO [Listener at localhost/46467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 01:01:52,873 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,873 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 01:01:52,873 INFO [Listener at localhost/46467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 01:01:52,875 INFO [Listener at localhost/46467] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34471 2023-09-23 01:01:52,876 INFO [Listener at localhost/46467] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 01:01:52,877 INFO [Listener at localhost/46467] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 01:01:52,878 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,881 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,885 INFO [Listener at localhost/46467] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34471 connecting to ZooKeeper ensemble=127.0.0.1:64606 2023-09-23 01:01:52,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:344710x0, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 01:01:52,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34471-0x100d64dda910002 connected 2023-09-23 01:01:52,891 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 01:01:52,892 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:01:52,892 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 01:01:52,897 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34471 2023-09-23 01:01:52,897 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34471 2023-09-23 01:01:52,898 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34471 2023-09-23 01:01:52,898 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34471 2023-09-23 01:01:52,899 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34471 2023-09-23 01:01:52,917 INFO [Listener at localhost/46467] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-23 01:01:52,918 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,918 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,918 INFO [Listener at localhost/46467] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-23 01:01:52,918 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-23 01:01:52,918 INFO [Listener at localhost/46467] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-23 01:01:52,919 INFO [Listener at localhost/46467] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-23 01:01:52,920 INFO [Listener at localhost/46467] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40973 2023-09-23 01:01:52,921 INFO [Listener at localhost/46467] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-23 01:01:52,922 INFO [Listener at localhost/46467] mob.MobFileCache(124): MobFileCache disabled 2023-09-23 01:01:52,923 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,925 INFO [Listener at localhost/46467] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:52,928 INFO [Listener at localhost/46467] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40973 connecting to ZooKeeper ensemble=127.0.0.1:64606 2023-09-23 01:01:52,932 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:409730x0, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-23 01:01:52,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40973-0x100d64dda910003 connected 2023-09-23 01:01:52,933 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 01:01:52,933 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:01:52,934 DEBUG [Listener at localhost/46467] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-23 01:01:52,935 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40973 2023-09-23 01:01:52,935 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40973 2023-09-23 01:01:52,936 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40973 2023-09-23 01:01:52,936 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40973 2023-09-23 01:01:52,937 DEBUG [Listener at localhost/46467] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40973 2023-09-23 01:01:52,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:52,948 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 01:01:52,950 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:52,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 01:01:52,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 01:01:52,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 01:01:52,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-23 01:01:52,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:52,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 01:01:52,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42795,1695430911629 from backup master directory 2023-09-23 01:01:52,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-23 01:01:52,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:52,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-23 01:01:52,978 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 01:01:52,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:52,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-23 01:01:52,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-23 01:01:53,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/hbase.id with ID: cec82a72-1eee-4852-8ce5-beb361b552f7 2023-09-23 01:01:53,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-23 01:01:53,141 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:53,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4eb63c24 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:01:53,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4120ce5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:01:53,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 01:01:53,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-23 01:01:53,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-23 01:01:53,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-23 01:01:53,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 01:01:53,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-23 01:01:53,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 01:01:53,320 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store-tmp 2023-09-23 01:01:53,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:53,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 01:01:53,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:01:53,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:01:53,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 01:01:53,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:01:53,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:01:53,360 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 01:01:53,362 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/WALs/jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:53,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42795%2C1695430911629, suffix=, logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/WALs/jenkins-hbase4.apache.org,42795,1695430911629, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/oldWALs, maxLogs=10 2023-09-23 01:01:53,452 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK] 2023-09-23 01:01:53,452 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK] 2023-09-23 01:01:53,452 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK] 2023-09-23 01:01:53,461 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-23 01:01:53,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/WALs/jenkins-hbase4.apache.org,42795,1695430911629/jenkins-hbase4.apache.org%2C42795%2C1695430911629.1695430913407 2023-09-23 01:01:53,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK], DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK], DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK]] 2023-09-23 01:01:53,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-23 01:01:53,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:53,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 01:01:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 01:01:53,602 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-23 01:01:53,609 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-23 01:01:53,637 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-23 01:01:53,649 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:53,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 01:01:53,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-23 01:01:53,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-23 01:01:53,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:01:53,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74697781, jitterRate=0.11308367550373077}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:01:53,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 01:01:53,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-23 01:01:53,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-23 01:01:53,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-23 01:01:53,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-23 01:01:53,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-23 01:01:53,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 36 msec 2023-09-23 01:01:53,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-23 01:01:53,774 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-23 01:01:53,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-23 01:01:53,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-23 01:01:53,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-23 01:01:53,811 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-23 01:01:53,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-23 01:01:53,821 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-23 01:01:53,824 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:53,825 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-23 01:01:53,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-23 01:01:53,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-23 01:01:53,851 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 01:01:53,851 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 01:01:53,851 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 01:01:53,851 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-23 01:01:53,852 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:53,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42795,1695430911629, sessionid=0x100d64dda910000, setting cluster-up flag (Was=false) 2023-09-23 01:01:53,869 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:53,875 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-23 01:01:53,877 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:53,882 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:53,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-23 01:01:53,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:53,893 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp 2023-09-23 01:01:53,941 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(951): ClusterId : cec82a72-1eee-4852-8ce5-beb361b552f7 2023-09-23 01:01:53,941 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(951): ClusterId : cec82a72-1eee-4852-8ce5-beb361b552f7 2023-09-23 01:01:53,942 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(951): ClusterId : cec82a72-1eee-4852-8ce5-beb361b552f7 2023-09-23 01:01:53,947 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 01:01:53,947 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 01:01:53,947 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-23 01:01:53,955 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 01:01:53,955 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 01:01:53,955 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-23 01:01:53,955 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 01:01:53,955 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 01:01:53,955 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-23 01:01:53,959 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 01:01:53,961 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 01:01:53,963 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-23 01:01:53,964 DEBUG [RS:2;jenkins-hbase4:40973] zookeeper.ReadOnlyZKClient(139): Connect 0x09c10f09 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:01:53,965 DEBUG [RS:0;jenkins-hbase4:35139] zookeeper.ReadOnlyZKClient(139): Connect 0x3340701e to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:01:53,967 DEBUG [RS:1;jenkins-hbase4:34471] zookeeper.ReadOnlyZKClient(139): Connect 0x798a598e to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:01:53,977 DEBUG [RS:2;jenkins-hbase4:40973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@706f041, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:01:53,978 DEBUG [RS:0;jenkins-hbase4:35139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d879806, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:01:53,978 DEBUG [RS:2;jenkins-hbase4:40973] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3396479, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 01:01:53,978 DEBUG [RS:0;jenkins-hbase4:35139] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39b81b6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 01:01:53,979 DEBUG [RS:1;jenkins-hbase4:34471] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@774db8cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:01:53,979 DEBUG [RS:1;jenkins-hbase4:34471] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@737232fe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 01:01:53,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-23 01:01:54,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:54,001 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-23 01:01:54,012 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:35139 2023-09-23 01:01:54,012 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40973 2023-09-23 01:01:54,013 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34471 2023-09-23 01:01:54,017 INFO [RS:0;jenkins-hbase4:35139] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 01:01:54,017 INFO [RS:2;jenkins-hbase4:40973] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 01:01:54,018 INFO [RS:2;jenkins-hbase4:40973] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 01:01:54,017 INFO [RS:1;jenkins-hbase4:34471] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-23 01:01:54,018 INFO [RS:0;jenkins-hbase4:35139] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 01:01:54,018 INFO [RS:1;jenkins-hbase4:34471] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-23 01:01:54,018 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 01:01:54,018 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 01:01:54,018 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-23 01:01:54,020 INFO [RS:0;jenkins-hbase4:35139] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:54,020 INFO [RS:2;jenkins-hbase4:40973] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:54,020 INFO [RS:1;jenkins-hbase4:34471] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:54,021 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 01:01:54,020 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 01:01:54,020 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1022): About to register with Master. 2023-09-23 01:01:54,024 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1695430911629 with isa=jenkins-hbase4.apache.org/172.31.14.131:34471, startcode=1695430912871 2023-09-23 01:01:54,024 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1695430911629 with isa=jenkins-hbase4.apache.org/172.31.14.131:35139, startcode=1695430912822 2023-09-23 01:01:54,024 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1695430911629 with isa=jenkins-hbase4.apache.org/172.31.14.131:40973, startcode=1695430912916 2023-09-23 01:01:54,043 DEBUG [RS:2;jenkins-hbase4:40973] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 01:01:54,043 DEBUG [RS:0;jenkins-hbase4:35139] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 01:01:54,043 DEBUG [RS:1;jenkins-hbase4:34471] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-23 01:01:54,104 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-23 01:01:54,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 01:01:54,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 01:01:54,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 01:01:54,116 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-23 01:01:54,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-23 01:01:54,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 01:01:54,117 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695430944120 2023-09-23 01:01:54,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-23 01:01:54,126 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 01:01:54,126 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-23 01:01:54,127 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60401, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 01:01:54,127 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60233, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 01:01:54,127 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52237, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-23 01:01:54,134 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 01:01:54,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-23 01:01:54,138 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 01:01:54,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-23 01:01:54,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-23 01:01:54,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-23 01:01:54,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-23 01:01:54,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-23 01:01:54,151 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 01:01:54,153 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-23 01:01:54,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-23 01:01:54,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-23 01:01:54,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-23 01:01:54,162 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-23 01:01:54,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695430914166,5,FailOnTimeoutGroup] 2023-09-23 01:01:54,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695430914167,5,FailOnTimeoutGroup] 2023-09-23 01:01:54,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-23 01:01:54,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,169 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,190 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 01:01:54,191 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-23 01:01:54,191 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:01:54,193 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 01:01:54,193 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 01:01:54,193 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(2830): Master is not running yet 2023-09-23 01:01:54,193 WARN [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 01:01:54,193 WARN [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 01:01:54,194 WARN [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-23 01:01:54,216 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:54,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 01:01:54,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/info 2023-09-23 01:01:54,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 01:01:54,221 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:54,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 01:01:54,224 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/rep_barrier 2023-09-23 01:01:54,225 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 01:01:54,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:54,226 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 01:01:54,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/table 2023-09-23 01:01:54,228 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 01:01:54,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:54,230 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740 2023-09-23 01:01:54,231 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740 2023-09-23 01:01:54,234 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 01:01:54,236 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 01:01:54,240 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:01:54,241 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75089066, jitterRate=0.11891427636146545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 01:01:54,241 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 01:01:54,242 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 01:01:54,242 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 01:01:54,242 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 01:01:54,242 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 01:01:54,242 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 01:01:54,243 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 01:01:54,244 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 01:01:54,249 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-23 01:01:54,249 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-23 01:01:54,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-23 01:01:54,272 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-23 01:01:54,275 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-23 01:01:54,295 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1695430911629 with isa=jenkins-hbase4.apache.org/172.31.14.131:35139, startcode=1695430912822 2023-09-23 01:01:54,295 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1695430911629 with isa=jenkins-hbase4.apache.org/172.31.14.131:40973, startcode=1695430912916 2023-09-23 01:01:54,295 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42795,1695430911629 with isa=jenkins-hbase4.apache.org/172.31.14.131:34471, startcode=1695430912871 2023-09-23 01:01:54,301 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,306 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,307 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:01:54,307 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42795] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,308 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36407 2023-09-23 01:01:54,308 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 01:01:54,308 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:01:54,308 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36407 2023-09-23 01:01:54,309 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 01:01:54,309 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:01:54,309 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36407 2023-09-23 01:01:54,309 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-23 01:01:54,318 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 01:01:54,319 DEBUG [RS:2;jenkins-hbase4:40973] zookeeper.ZKUtil(162): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,319 DEBUG [RS:1;jenkins-hbase4:34471] zookeeper.ZKUtil(162): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,319 WARN [RS:2;jenkins-hbase4:40973] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 01:01:54,319 DEBUG [RS:0;jenkins-hbase4:35139] zookeeper.ZKUtil(162): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,320 INFO [RS:2;jenkins-hbase4:40973] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 01:01:54,320 WARN [RS:0;jenkins-hbase4:35139] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 01:01:54,319 WARN [RS:1;jenkins-hbase4:34471] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-23 01:01:54,321 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,321 INFO [RS:1;jenkins-hbase4:34471] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 01:01:54,320 INFO [RS:0;jenkins-hbase4:35139] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 01:01:54,321 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,321 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,321 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35139,1695430912822] 2023-09-23 01:01:54,321 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34471,1695430912871] 2023-09-23 01:01:54,321 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40973,1695430912916] 2023-09-23 01:01:54,335 DEBUG [RS:1;jenkins-hbase4:34471] zookeeper.ZKUtil(162): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,335 DEBUG [RS:0;jenkins-hbase4:35139] zookeeper.ZKUtil(162): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,335 DEBUG [RS:2;jenkins-hbase4:40973] zookeeper.ZKUtil(162): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,335 DEBUG [RS:1;jenkins-hbase4:34471] zookeeper.ZKUtil(162): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,335 DEBUG [RS:0;jenkins-hbase4:35139] zookeeper.ZKUtil(162): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,335 DEBUG [RS:2;jenkins-hbase4:40973] zookeeper.ZKUtil(162): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,336 DEBUG [RS:1;jenkins-hbase4:34471] zookeeper.ZKUtil(162): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,336 DEBUG [RS:0;jenkins-hbase4:35139] zookeeper.ZKUtil(162): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,336 DEBUG [RS:2;jenkins-hbase4:40973] zookeeper.ZKUtil(162): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,349 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 01:01:54,349 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 01:01:54,349 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-23 01:01:54,360 INFO [RS:0;jenkins-hbase4:35139] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 01:01:54,360 INFO [RS:1;jenkins-hbase4:34471] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 01:01:54,361 INFO [RS:2;jenkins-hbase4:40973] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-23 01:01:54,385 INFO [RS:0;jenkins-hbase4:35139] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 01:01:54,385 INFO [RS:1;jenkins-hbase4:34471] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 01:01:54,385 INFO [RS:2;jenkins-hbase4:40973] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-23 01:01:54,390 INFO [RS:0;jenkins-hbase4:35139] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 01:01:54,390 INFO [RS:2;jenkins-hbase4:40973] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 01:01:54,391 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,390 INFO [RS:1;jenkins-hbase4:34471] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-23 01:01:54,391 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,391 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,392 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 01:01:54,392 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 01:01:54,392 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-23 01:01:54,401 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,401 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,401 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,401 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,402 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 01:01:54,403 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 01:01:54,403 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:0;jenkins-hbase4:35139] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,403 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,404 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,404 DEBUG [RS:1;jenkins-hbase4:34471] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,404 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-23 01:01:54,404 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,404 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,405 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,405 DEBUG [RS:2;jenkins-hbase4:40973] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-23 01:01:54,406 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,406 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,406 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,406 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,407 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,407 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,411 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,411 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,411 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,428 DEBUG [jenkins-hbase4:42795] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-23 01:01:54,429 INFO [RS:2;jenkins-hbase4:40973] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 01:01:54,430 INFO [RS:1;jenkins-hbase4:34471] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 01:01:54,429 INFO [RS:0;jenkins-hbase4:35139] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-23 01:01:54,433 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34471,1695430912871-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,433 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35139,1695430912822-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,433 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40973,1695430912916-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,435 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:01:54,443 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:01:54,443 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:01:54,443 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:01:54,443 DEBUG [jenkins-hbase4:42795] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:01:54,454 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40973,1695430912916, state=OPENING 2023-09-23 01:01:54,460 INFO [RS:1;jenkins-hbase4:34471] regionserver.Replication(203): jenkins-hbase4.apache.org,34471,1695430912871 started 2023-09-23 01:01:54,460 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34471,1695430912871, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34471, sessionid=0x100d64dda910002 2023-09-23 01:01:54,461 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 01:01:54,461 DEBUG [RS:1;jenkins-hbase4:34471] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,461 DEBUG [RS:1;jenkins-hbase4:34471] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34471,1695430912871' 2023-09-23 01:01:54,461 DEBUG [RS:1;jenkins-hbase4:34471] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 01:01:54,462 INFO [RS:0;jenkins-hbase4:35139] regionserver.Replication(203): jenkins-hbase4.apache.org,35139,1695430912822 started 2023-09-23 01:01:54,462 DEBUG [RS:1;jenkins-hbase4:34471] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 01:01:54,462 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,35139,1695430912822, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35139, sessionid=0x100d64dda910001 2023-09-23 01:01:54,462 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 01:01:54,462 DEBUG [RS:0;jenkins-hbase4:35139] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,463 DEBUG [RS:0;jenkins-hbase4:35139] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35139,1695430912822' 2023-09-23 01:01:54,463 DEBUG [RS:0;jenkins-hbase4:35139] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 01:01:54,464 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 01:01:54,464 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 01:01:54,464 DEBUG [RS:1;jenkins-hbase4:34471] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:54,464 DEBUG [RS:1;jenkins-hbase4:34471] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34471,1695430912871' 2023-09-23 01:01:54,464 DEBUG [RS:1;jenkins-hbase4:34471] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:01:54,464 DEBUG [RS:0;jenkins-hbase4:35139] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 01:01:54,467 INFO [RS:2;jenkins-hbase4:40973] regionserver.Replication(203): jenkins-hbase4.apache.org,40973,1695430912916 started 2023-09-23 01:01:54,467 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40973,1695430912916, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40973, sessionid=0x100d64dda910003 2023-09-23 01:01:54,467 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 01:01:54,467 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-23 01:01:54,467 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 01:01:54,467 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-23 01:01:54,467 DEBUG [RS:1;jenkins-hbase4:34471] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:01:54,467 DEBUG [RS:0;jenkins-hbase4:35139] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:54,467 DEBUG [RS:2;jenkins-hbase4:40973] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,468 DEBUG [RS:0;jenkins-hbase4:35139] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35139,1695430912822' 2023-09-23 01:01:54,468 DEBUG [RS:2;jenkins-hbase4:40973] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40973,1695430912916' 2023-09-23 01:01:54,468 DEBUG [RS:2;jenkins-hbase4:40973] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-23 01:01:54,468 DEBUG [RS:0;jenkins-hbase4:35139] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:01:54,470 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:54,470 DEBUG [RS:1;jenkins-hbase4:34471] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 01:01:54,470 DEBUG [RS:0;jenkins-hbase4:35139] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:01:54,470 DEBUG [RS:2;jenkins-hbase4:40973] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-23 01:01:54,470 INFO [RS:1;jenkins-hbase4:34471] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 01:01:54,470 INFO [RS:1;jenkins-hbase4:34471] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 01:01:54,470 DEBUG [RS:0;jenkins-hbase4:35139] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 01:01:54,470 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 01:01:54,470 INFO [RS:0;jenkins-hbase4:35139] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 01:01:54,471 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-23 01:01:54,471 INFO [RS:0;jenkins-hbase4:35139] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 01:01:54,471 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-23 01:01:54,472 DEBUG [RS:2;jenkins-hbase4:40973] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,472 DEBUG [RS:2;jenkins-hbase4:40973] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40973,1695430912916' 2023-09-23 01:01:54,472 DEBUG [RS:2;jenkins-hbase4:40973] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:01:54,472 DEBUG [RS:2;jenkins-hbase4:40973] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:01:54,473 DEBUG [RS:2;jenkins-hbase4:40973] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-23 01:01:54,473 INFO [RS:2;jenkins-hbase4:40973] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-23 01:01:54,473 INFO [RS:2;jenkins-hbase4:40973] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-23 01:01:54,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:01:54,582 INFO [RS:0;jenkins-hbase4:35139] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35139%2C1695430912822, suffix=, logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,35139,1695430912822, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs, maxLogs=32 2023-09-23 01:01:54,582 INFO [RS:1;jenkins-hbase4:34471] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34471%2C1695430912871, suffix=, logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,34471,1695430912871, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs, maxLogs=32 2023-09-23 01:01:54,582 INFO [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40973%2C1695430912916, suffix=, logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,40973,1695430912916, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs, maxLogs=32 2023-09-23 01:01:54,608 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK] 2023-09-23 01:01:54,608 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK] 2023-09-23 01:01:54,608 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK] 2023-09-23 01:01:54,617 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK] 2023-09-23 01:01:54,618 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK] 2023-09-23 01:01:54,619 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK] 2023-09-23 01:01:54,621 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK] 2023-09-23 01:01:54,623 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK] 2023-09-23 01:01:54,625 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK] 2023-09-23 01:01:54,625 INFO [RS:0;jenkins-hbase4:35139] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,35139,1695430912822/jenkins-hbase4.apache.org%2C35139%2C1695430912822.1695430914587 2023-09-23 01:01:54,637 DEBUG [RS:0;jenkins-hbase4:35139] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK], DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK], DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK]] 2023-09-23 01:01:54,639 INFO [RS:1;jenkins-hbase4:34471] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,34471,1695430912871/jenkins-hbase4.apache.org%2C34471%2C1695430912871.1695430914587 2023-09-23 01:01:54,639 INFO [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,40973,1695430912916/jenkins-hbase4.apache.org%2C40973%2C1695430912916.1695430914587 2023-09-23 01:01:54,639 DEBUG [RS:1;jenkins-hbase4:34471] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK], DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK], DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK]] 2023-09-23 01:01:54,641 DEBUG [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK], DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK], DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK]] 2023-09-23 01:01:54,667 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:01:54,669 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 01:01:54,672 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 01:01:54,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-23 01:01:54,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-23 01:01:54,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40973%2C1695430912916.meta, suffix=.meta, logDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,40973,1695430912916, archiveDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs, maxLogs=32 2023-09-23 01:01:54,719 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK] 2023-09-23 01:01:54,720 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK] 2023-09-23 01:01:54,721 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK] 2023-09-23 01:01:54,725 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/WALs/jenkins-hbase4.apache.org,40973,1695430912916/jenkins-hbase4.apache.org%2C40973%2C1695430912916.meta.1695430914695.meta 2023-09-23 01:01:54,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41165,DS-ef615322-02c7-4587-92c9-dd6702dc13b6,DISK], DatanodeInfoWithStorage[127.0.0.1:40997,DS-9ee30b40-f916-404e-9eb1-7bff6ff2036d,DISK], DatanodeInfoWithStorage[127.0.0.1:34891,DS-95c7c3ad-7a6e-4064-a50c-e679cde338bb,DISK]] 2023-09-23 01:01:54,726 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-23 01:01:54,727 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-23 01:01:54,729 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:54,730 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-23 01:01:54,732 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-23 01:01:54,734 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-23 01:01:54,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-23 01:01:54,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:54,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-23 01:01:54,748 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-23 01:01:54,751 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-23 01:01:54,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/info 2023-09-23 01:01:54,753 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/info 2023-09-23 01:01:54,754 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-23 01:01:54,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:54,755 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-23 01:01:54,756 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/rep_barrier 2023-09-23 01:01:54,756 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/rep_barrier 2023-09-23 01:01:54,757 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-23 01:01:54,757 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:54,758 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-23 01:01:54,759 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/table 2023-09-23 01:01:54,759 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/table 2023-09-23 01:01:54,759 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-23 01:01:54,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:54,762 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740 2023-09-23 01:01:54,768 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740 2023-09-23 01:01:54,772 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-23 01:01:54,775 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-23 01:01:54,776 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68312954, jitterRate=0.017942339181900024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-23 01:01:54,779 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-23 01:01:54,791 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695430914655 2023-09-23 01:01:54,810 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-23 01:01:54,811 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-23 01:01:54,812 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40973,1695430912916, state=OPEN 2023-09-23 01:01:54,815 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-23 01:01:54,815 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-23 01:01:54,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-23 01:01:54,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40973,1695430912916 in 339 msec 2023-09-23 01:01:54,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-23 01:01:54,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 562 msec 2023-09-23 01:01:54,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 820 msec 2023-09-23 01:01:54,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695430914832, completionTime=-1 2023-09-23 01:01:54,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-23 01:01:54,832 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-23 01:01:54,934 DEBUG [hconnection-0x1778af6b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:01:54,938 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49114, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:01:54,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-23 01:01:54,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695430974959 2023-09-23 01:01:54,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695431034959 2023-09-23 01:01:54,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 126 msec 2023-09-23 01:01:54,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1695430911629-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1695430911629-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1695430911629-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42795, period=300000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:54,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-23 01:01:55,001 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-23 01:01:55,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-23 01:01:55,011 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 01:01:55,022 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-23 01:01:55,025 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:01:55,029 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:01:55,056 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,059 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1 empty. 2023-09-23 01:01:55,060 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,060 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-23 01:01:55,096 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-23 01:01:55,099 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2916ba6bb16b1912c7747fea582d98f1, NAME => 'hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:01:55,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:55,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2916ba6bb16b1912c7747fea582d98f1, disabling compactions & flushes 2023-09-23 01:01:55,121 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. after waiting 0 ms 2023-09-23 01:01:55,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,121 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,121 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2916ba6bb16b1912c7747fea582d98f1: 2023-09-23 01:01:55,127 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:01:55,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695430915130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430915130"}]},"ts":"1695430915130"} 2023-09-23 01:01:55,169 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 01:01:55,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:01:55,177 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430915172"}]},"ts":"1695430915172"} 2023-09-23 01:01:55,184 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-23 01:01:55,191 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:01:55,192 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:01:55,192 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:01:55,192 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:01:55,192 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:01:55,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2916ba6bb16b1912c7747fea582d98f1, ASSIGN}] 2023-09-23 01:01:55,198 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2916ba6bb16b1912c7747fea582d98f1, ASSIGN 2023-09-23 01:01:55,200 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2916ba6bb16b1912c7747fea582d98f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:01:55,352 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 01:01:55,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2916ba6bb16b1912c7747fea582d98f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:55,354 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695430915353"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430915353"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430915353"}]},"ts":"1695430915353"} 2023-09-23 01:01:55,358 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2916ba6bb16b1912c7747fea582d98f1, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:01:55,513 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:55,513 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 01:01:55,516 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 01:01:55,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2916ba6bb16b1912c7747fea582d98f1, NAME => 'hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.', STARTKEY => '', ENDKEY => ''} 2023-09-23 01:01:55,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. service=AccessControlService 2023-09-23 01:01:55,526 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:55,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,526 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:55,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,527 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,529 INFO [StoreOpener-2916ba6bb16b1912c7747fea582d98f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,531 DEBUG [StoreOpener-2916ba6bb16b1912c7747fea582d98f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/info 2023-09-23 01:01:55,531 DEBUG [StoreOpener-2916ba6bb16b1912c7747fea582d98f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/info 2023-09-23 01:01:55,532 INFO [StoreOpener-2916ba6bb16b1912c7747fea582d98f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2916ba6bb16b1912c7747fea582d98f1 columnFamilyName info 2023-09-23 01:01:55,532 INFO [StoreOpener-2916ba6bb16b1912c7747fea582d98f1-1] regionserver.HStore(310): Store=2916ba6bb16b1912c7747fea582d98f1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:55,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,535 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:01:55,544 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:01:55,545 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2916ba6bb16b1912c7747fea582d98f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69631552, jitterRate=0.037590980529785156}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:01:55,545 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2916ba6bb16b1912c7747fea582d98f1: 2023-09-23 01:01:55,547 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1., pid=6, masterSystemTime=1695430915513 2023-09-23 01:01:55,551 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:01:55,553 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2916ba6bb16b1912c7747fea582d98f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:01:55,554 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695430915553"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430915553"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430915553"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430915553"}]},"ts":"1695430915553"} 2023-09-23 01:01:55,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-23 01:01:55,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2916ba6bb16b1912c7747fea582d98f1, server=jenkins-hbase4.apache.org,35139,1695430912822 in 198 msec 2023-09-23 01:01:55,566 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-23 01:01:55,567 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2916ba6bb16b1912c7747fea582d98f1, ASSIGN in 365 msec 2023-09-23 01:01:55,568 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:01:55,568 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430915568"}]},"ts":"1695430915568"} 2023-09-23 01:01:55,571 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-23 01:01:55,574 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:01:55,577 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 563 msec 2023-09-23 01:01:55,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-23 01:01:55,627 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-23 01:01:55,627 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:01:55,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:01:55,652 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:01:55,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-23 01:01:55,686 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 01:01:55,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2023-09-23 01:01:55,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-23 01:01:55,713 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-23 01:01:55,719 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-23 01:01:55,727 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-23 01:01:55,730 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-23 01:01:55,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.752sec 2023-09-23 01:01:55,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-23 01:01:55,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-23 01:01:55,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-23 01:01:55,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1695430911629-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-23 01:01:55,737 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42795,1695430911629-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-23 01:01:55,746 DEBUG [Listener at localhost/46467] zookeeper.ReadOnlyZKClient(139): Connect 0x21c22958 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:01:55,751 DEBUG [Listener at localhost/46467] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bcebd71, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:01:55,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-23 01:01:55,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-23 01:01:55,766 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:01:55,766 DEBUG [hconnection-0x60d85d60-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:01:55,767 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:01:55,770 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/acl/796811673120186992f91cc2ce1d423b 2023-09-23 01:01:55,771 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/acl/796811673120186992f91cc2ce1d423b empty. 2023-09-23 01:01:55,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-23 01:01:55,774 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/acl/796811673120186992f91cc2ce1d423b 2023-09-23 01:01:55,774 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-23 01:01:55,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 01:01:55,784 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:01:55,787 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:01:55,787 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-23 01:01:55,787 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/test.cache.data in system properties and HBase conf 2023-09-23 01:01:55,787 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop.tmp.dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop.log.dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 01:01:55,788 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-23 01:01:55,789 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-23 01:01:55,789 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-23 01:01:55,789 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 01:01:55,790 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-23 01:01:55,790 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/nfs.dump.dir in system properties and HBase conf 2023-09-23 01:01:55,790 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir in system properties and HBase conf 2023-09-23 01:01:55,790 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-23 01:01:55,790 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-23 01:01:55,790 INFO [Listener at localhost/46467] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-23 01:01:55,812 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-23 01:01:55,814 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 796811673120186992f91cc2ce1d423b, NAME => 'hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:01:55,842 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:55,842 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 796811673120186992f91cc2ce1d423b, disabling compactions & flushes 2023-09-23 01:01:55,842 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:55,842 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:55,842 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. after waiting 0 ms 2023-09-23 01:01:55,842 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:55,842 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:55,842 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 796811673120186992f91cc2ce1d423b: 2023-09-23 01:01:55,848 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:01:55,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695430915858"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430915858"}]},"ts":"1695430915858"} 2023-09-23 01:01:55,863 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-23 01:01:55,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:01:55,866 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430915865"}]},"ts":"1695430915865"} 2023-09-23 01:01:55,868 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-23 01:01:55,873 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:01:55,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:01:55,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:01:55,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:01:55,874 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:01:55,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=796811673120186992f91cc2ce1d423b, ASSIGN}] 2023-09-23 01:01:55,877 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=796811673120186992f91cc2ce1d423b, ASSIGN 2023-09-23 01:01:55,882 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=796811673120186992f91cc2ce1d423b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34471,1695430912871; forceNewPlan=false, retain=false 2023-09-23 01:01:55,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 01:01:56,032 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 01:01:56,033 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=796811673120186992f91cc2ce1d423b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:56,034 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695430916033"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430916033"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430916033"}]},"ts":"1695430916033"} 2023-09-23 01:01:56,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 796811673120186992f91cc2ce1d423b, server=jenkins-hbase4.apache.org,34471,1695430912871}] 2023-09-23 01:01:56,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 01:01:56,192 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:56,193 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 01:01:56,196 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 01:01:56,203 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:56,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 796811673120186992f91cc2ce1d423b, NAME => 'hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.', STARTKEY => '', ENDKEY => ''} 2023-09-23 01:01:56,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. service=AccessControlService 2023-09-23 01:01:56,204 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:01:56,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:01:56,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,205 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,208 INFO [StoreOpener-796811673120186992f91cc2ce1d423b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,211 DEBUG [StoreOpener-796811673120186992f91cc2ce1d423b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/l 2023-09-23 01:01:56,211 DEBUG [StoreOpener-796811673120186992f91cc2ce1d423b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/l 2023-09-23 01:01:56,211 INFO [StoreOpener-796811673120186992f91cc2ce1d423b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 796811673120186992f91cc2ce1d423b columnFamilyName l 2023-09-23 01:01:56,212 INFO [StoreOpener-796811673120186992f91cc2ce1d423b-1] regionserver.HStore(310): Store=796811673120186992f91cc2ce1d423b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:01:56,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,216 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,222 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 796811673120186992f91cc2ce1d423b 2023-09-23 01:01:56,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:01:56,228 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 796811673120186992f91cc2ce1d423b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71536084, jitterRate=0.06597071886062622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:01:56,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 796811673120186992f91cc2ce1d423b: 2023-09-23 01:01:56,233 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b., pid=11, masterSystemTime=1695430916192 2023-09-23 01:01:56,237 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:56,238 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:01:56,239 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=796811673120186992f91cc2ce1d423b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:01:56,239 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695430916239"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430916239"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430916239"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430916239"}]},"ts":"1695430916239"} 2023-09-23 01:01:56,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-23 01:01:56,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 796811673120186992f91cc2ce1d423b, server=jenkins-hbase4.apache.org,34471,1695430912871 in 206 msec 2023-09-23 01:01:56,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-23 01:01:56,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=796811673120186992f91cc2ce1d423b, ASSIGN in 373 msec 2023-09-23 01:01:56,252 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:01:56,253 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430916253"}]},"ts":"1695430916253"} 2023-09-23 01:01:56,255 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-23 01:01:56,260 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:01:56,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 499 msec 2023-09-23 01:01:56,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-23 01:01:56,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-23 01:01:56,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-23 01:01:56,971 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:57,352 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:57,360 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41807_jobhistory____zc9g0b/webapp 2023-09-23 01:01:57,533 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-23 01:01:57,533 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-23 01:01:57,533 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 01:01:57,538 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 01:01:57,626 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:57,966 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:58,251 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-23 01:01:58,283 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41807 2023-09-23 01:01:58,469 WARN [Listener at jenkins-hbase4.apache.org/45813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:58,787 WARN [Listener at jenkins-hbase4.apache.org/45813] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 01:01:58,788 INFO [Listener at jenkins-hbase4.apache.org/45813] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:58,795 INFO [Listener at jenkins-hbase4.apache.org/45813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41849_cluster____.4a041o/webapp 2023-09-23 01:01:58,872 INFO [Listener at jenkins-hbase4.apache.org/45813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 01:01:58,873 INFO [Listener at jenkins-hbase4.apache.org/45813] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-23 01:01:58,873 INFO [Listener at jenkins-hbase4.apache.org/45813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 01:01:58,874 INFO [Listener at jenkins-hbase4.apache.org/45813] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 01:01:58,887 INFO [Listener at jenkins-hbase4.apache.org/45813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:59,133 INFO [Listener at jenkins-hbase4.apache.org/45813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:59,257 INFO [Listener at jenkins-hbase4.apache.org/45813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:59,266 INFO [Listener at jenkins-hbase4.apache.org/45813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41849 2023-09-23 01:01:59,718 WARN [Listener at jenkins-hbase4.apache.org/46851] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:01:59,744 WARN [Listener at jenkins-hbase4.apache.org/46851] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 01:01:59,745 INFO [Listener at jenkins-hbase4.apache.org/46851] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:01:59,752 INFO [Listener at jenkins-hbase4.apache.org/46851] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44651_node____.r05d68/webapp 2023-09-23 01:01:59,832 INFO [Listener at jenkins-hbase4.apache.org/46851] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 01:01:59,832 INFO [Listener at jenkins-hbase4.apache.org/46851] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 01:01:59,832 INFO [Listener at jenkins-hbase4.apache.org/46851] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 01:01:59,832 INFO [Listener at jenkins-hbase4.apache.org/46851] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 01:01:59,840 INFO [Listener at jenkins-hbase4.apache.org/46851] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:59,861 INFO [Listener at jenkins-hbase4.apache.org/46851] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:59,954 INFO [Listener at jenkins-hbase4.apache.org/46851] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:01:59,968 INFO [Listener at jenkins-hbase4.apache.org/46851] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44651 2023-09-23 01:02:00,157 WARN [Listener at jenkins-hbase4.apache.org/33411] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-23 01:02:00,163 WARN [Listener at jenkins-hbase4.apache.org/33411] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-23 01:02:00,163 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): jetty-6.1.26 2023-09-23 01:02:00,173 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41573_node____121jle/webapp 2023-09-23 01:02:00,234 INFO [Listener at jenkins-hbase4.apache.org/33411] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-23 01:02:00,234 INFO [Listener at jenkins-hbase4.apache.org/33411] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-23 01:02:00,234 INFO [Listener at jenkins-hbase4.apache.org/33411] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-23 01:02:00,234 INFO [Listener at jenkins-hbase4.apache.org/33411] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-23 01:02:00,242 INFO [Listener at jenkins-hbase4.apache.org/33411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:02:00,256 INFO [Listener at jenkins-hbase4.apache.org/33411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:02:00,297 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:02:00,354 INFO [Listener at jenkins-hbase4.apache.org/33411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-23 01:02:00,377 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41573 2023-09-23 01:02:00,408 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-23 01:02:00,410 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:00,488 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=169, AvailableMemoryMB=2296 2023-09-23 01:02:00,488 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-09-23 01:02:00,509 DEBUG [Listener at jenkins-hbase4.apache.org/33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-23 01:02:00,514 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-23 01:02:00,518 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-23 01:02:00,520 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-23 01:02:00,521 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-23 01:02:00,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 01:02:00,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:00,530 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:02:00,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-23 01:02:00,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 01:02:00,534 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:02:00,539 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:00,539 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:00,540 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee empty. 2023-09-23 01:02:00,540 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 empty. 2023-09-23 01:02:00,541 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:00,541 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:00,541 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 01:02:00,573 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-23 01:02:00,575 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83c6cc1ae7498bcdb88e166c3e2921ee, NAME => 'testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:02:00,575 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9b95fa1c6b0e320cb036d32f8e2df325, NAME => 'testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:02:00,618 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:00,619 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:00,619 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 83c6cc1ae7498bcdb88e166c3e2921ee, disabling compactions & flushes 2023-09-23 01:02:00,619 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 9b95fa1c6b0e320cb036d32f8e2df325, disabling compactions & flushes 2023-09-23 01:02:00,619 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:00,619 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:00,619 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. after waiting 0 ms 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. after waiting 0 ms 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:00,620 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:00,620 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 83c6cc1ae7498bcdb88e166c3e2921ee: 2023-09-23 01:02:00,620 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 9b95fa1c6b0e320cb036d32f8e2df325: 2023-09-23 01:02:00,625 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:02:00,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430920626"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430920626"}]},"ts":"1695430920626"} 2023-09-23 01:02:00,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430920626"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430920626"}]},"ts":"1695430920626"} 2023-09-23 01:02:00,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 01:02:00,674 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:02:00,676 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:02:00,676 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430920676"}]},"ts":"1695430920676"} 2023-09-23 01:02:00,678 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-23 01:02:00,683 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:02:00,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:02:00,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:02:00,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:02:00,686 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:02:00,687 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, ASSIGN}] 2023-09-23 01:02:00,689 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, ASSIGN 2023-09-23 01:02:00,689 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, ASSIGN 2023-09-23 01:02:00,691 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:02:00,691 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:02:00,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 01:02:00,841 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:02:00,843 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9b95fa1c6b0e320cb036d32f8e2df325, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:00,843 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=83c6cc1ae7498bcdb88e166c3e2921ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:00,844 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430920843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430920843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430920843"}]},"ts":"1695430920843"} 2023-09-23 01:02:00,844 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430920843"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430920843"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430920843"}]},"ts":"1695430920843"} 2023-09-23 01:02:00,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 9b95fa1c6b0e320cb036d32f8e2df325, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:02:00,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 83c6cc1ae7498bcdb88e166c3e2921ee, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:02:01,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:01,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:01,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83c6cc1ae7498bcdb88e166c3e2921ee, NAME => 'testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 01:02:01,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9b95fa1c6b0e320cb036d32f8e2df325, NAME => 'testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. service=AccessControlService 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. service=AccessControlService 2023-09-23 01:02:01,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:02:01,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,016 INFO [StoreOpener-83c6cc1ae7498bcdb88e166c3e2921ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,016 INFO [StoreOpener-9b95fa1c6b0e320cb036d32f8e2df325-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,018 DEBUG [StoreOpener-83c6cc1ae7498bcdb88e166c3e2921ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf 2023-09-23 01:02:01,019 DEBUG [StoreOpener-83c6cc1ae7498bcdb88e166c3e2921ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf 2023-09-23 01:02:01,019 DEBUG [StoreOpener-9b95fa1c6b0e320cb036d32f8e2df325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf 2023-09-23 01:02:01,019 DEBUG [StoreOpener-9b95fa1c6b0e320cb036d32f8e2df325-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf 2023-09-23 01:02:01,022 INFO [StoreOpener-83c6cc1ae7498bcdb88e166c3e2921ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83c6cc1ae7498bcdb88e166c3e2921ee columnFamilyName cf 2023-09-23 01:02:01,022 INFO [StoreOpener-9b95fa1c6b0e320cb036d32f8e2df325-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9b95fa1c6b0e320cb036d32f8e2df325 columnFamilyName cf 2023-09-23 01:02:01,025 INFO [StoreOpener-83c6cc1ae7498bcdb88e166c3e2921ee-1] regionserver.HStore(310): Store=83c6cc1ae7498bcdb88e166c3e2921ee/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:02:01,026 INFO [StoreOpener-9b95fa1c6b0e320cb036d32f8e2df325-1] regionserver.HStore(310): Store=9b95fa1c6b0e320cb036d32f8e2df325/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:02:01,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:01,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:01,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:02:01,048 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:02:01,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9b95fa1c6b0e320cb036d32f8e2df325; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67965746, jitterRate=0.012768536806106567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:02:01,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83c6cc1ae7498bcdb88e166c3e2921ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58843664, jitterRate=-0.12316107749938965}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:02:01,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9b95fa1c6b0e320cb036d32f8e2df325: 2023-09-23 01:02:01,050 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83c6cc1ae7498bcdb88e166c3e2921ee: 2023-09-23 01:02:01,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee., pid=16, masterSystemTime=1695430921001 2023-09-23 01:02:01,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325., pid=15, masterSystemTime=1695430921000 2023-09-23 01:02:01,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:01,058 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:01,059 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=9b95fa1c6b0e320cb036d32f8e2df325, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:01,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:01,059 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430921059"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430921059"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430921059"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430921059"}]},"ts":"1695430921059"} 2023-09-23 01:02:01,060 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=83c6cc1ae7498bcdb88e166c3e2921ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,060 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430921060"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430921060"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430921060"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430921060"}]},"ts":"1695430921060"} 2023-09-23 01:02:01,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-23 01:02:01,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 9b95fa1c6b0e320cb036d32f8e2df325, server=jenkins-hbase4.apache.org,40973,1695430912916 in 215 msec 2023-09-23 01:02:01,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-23 01:02:01,073 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 83c6cc1ae7498bcdb88e166c3e2921ee, server=jenkins-hbase4.apache.org,35139,1695430912822 in 216 msec 2023-09-23 01:02:01,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, ASSIGN in 381 msec 2023-09-23 01:02:01,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-23 01:02:01,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, ASSIGN in 387 msec 2023-09-23 01:02:01,078 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:02:01,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430921078"}]},"ts":"1695430921078"} 2023-09-23 01:02:01,081 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-23 01:02:01,084 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:02:01,089 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-23 01:02:01,095 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:01,099 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:01,104 DEBUG [hconnection-0x6d679b56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:01,107 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-23 01:02:01,116 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 01:02:01,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 01:02:01,148 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:01,149 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:01,148 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:01,148 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:01,149 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:02:01,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:01,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:01,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:01,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:01,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 632 msec 2023-09-23 01:02:01,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-23 01:02:01,642 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-23 01:02:01,646 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 01:02:01,647 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:01,650 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:01,672 DEBUG [hconnection-0x60d85d60-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:01,675 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:01,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 01:02:01,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430921693 (current time:1695430921693). 2023-09-23 01:02:01,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:02:01,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x6c5fb9b5 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:01,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fb020ad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:01,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:01,706 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:01,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c5fb9b5 to 127.0.0.1:64606 2023-09-23 01:02:01,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:01,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x1559e282 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:01,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75eb40c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:01,719 DEBUG [hconnection-0x53fbfe09-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:01,720 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:01,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:01,726 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:01,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1559e282 to 127.0.0.1:64606 2023-09-23 01:02:01,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:01,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 01:02:01,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:02:01,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 01:02:01,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 01:02:01,777 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 01:02:01,778 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695431521778 2023-09-23 01:02:01,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 01:02:01,778 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 01:02:01,781 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 01:02:01,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 01:02:01,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-09-23 01:02:01,785 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 01:02:01,785 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695431521785 2023-09-23 01:02:01,787 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:02:01,787 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:02:01,792 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:01,792 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-23 01:02:01,793 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:01,793 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-23 01:02:01,793 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 01:02:01,793 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-23 01:02:01,794 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:01,794 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-23 01:02:01,794 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 01:02:01,794 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-23 01:02:01,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,812 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-23 01:02:01,812 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:01,813 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 01:02:01,813 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 01:02:01,813 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,813 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,822 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:01,822 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,822 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:01,822 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:01,822 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,822 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,823 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,823 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:02:01,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 01:02:01,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 01:02:01,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 01:02:01,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,828 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 01:02:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 01:02:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 01:02:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 01:02:01,831 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 01:02:01,831 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 01:02:01,831 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 01:02:01,832 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 01:02:01,832 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 01:02:01,832 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 01:02:01,832 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-23 01:02:01,832 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-23 01:02:01,834 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,834 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:01,839 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,839 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,839 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,839 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:01,839 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:01,839 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:01,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:01,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456c36c4[Count = 1] remaining members to acquire global barrier 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:01,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:01,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-23 01:02:01,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456c36c4[Count = 0] remaining members to acquire global barrier 2023-09-23 01:02:01,845 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 01:02:01,845 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 01:02:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 01:02:01,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 01:02:01,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:02:01,848 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 01:02:01,849 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,849 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:02:01,849 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:01,850 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:01,850 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:01,850 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. started... 2023-09-23 01:02:01,852 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83c6cc1ae7498bcdb88e166c3e2921ee: 2023-09-23 01:02:01,853 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,856 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:01,856 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:01,856 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:01,856 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. started... 2023-09-23 01:02:01,856 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 01:02:01,856 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:01,856 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 01:02:01,857 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b95fa1c6b0e320cb036d32f8e2df325: 2023-09-23 01:02:01,858 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,861 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:01,861 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:01,865 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:02:01,865 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:02:01,887 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:01,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 01:02:01,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:01,903 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:02:01,913 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. completed. 2023-09-23 01:02:01,913 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:01,913 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:01,914 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:01,914 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,914 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 01:02:01,914 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:02:01,916 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. completed. 2023-09-23 01:02:01,916 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:01,916 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:01,916 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:01,916 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,916 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-23 01:02:01,916 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:02:01,916 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:01,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:01,917 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 01:02:01,917 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:01,917 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 01:02:01,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:01,921 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,921 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 01:02:01,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:01,921 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:01,921 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-23 01:02:01,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:01,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:02:01,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 01:02:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:01,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:01,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:02:01,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 01:02:01,930 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-23 01:02:01,930 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:02:01,930 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:02:01,930 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,930 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:01,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:01,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,935 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:01,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:01,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:01,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:01,935 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,936 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:01,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,939 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,940 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,940 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:01,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:01,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:01,954 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:01,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:01,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:01,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:01,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:01,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 01:02:01,954 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,956 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:01,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:01,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:01,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:01,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:02:01,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 01:02:01,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:01,980 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:02,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:02,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 01:02:02,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:02,030 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:02,030 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695430921779Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695430921977 (+198 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695430921977Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695430921977Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695430921991 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695430922017 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695430922029 (+12 ms) 2023-09-23 01:02:02,032 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 01:02:02,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 253 msec 2023-09-23 01:02:02,103 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:02,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 01:02:02,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:02:02,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35139] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:02:02,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40973] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:02:02,128 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-23 01:02:02,128 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:02,129 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:02,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 01:02:02,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430922144 (current time:1695430922144). 2023-09-23 01:02:02,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:02:02,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x49665447 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:02,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f32e835, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:02,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:02,154 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:02,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49665447 to 127.0.0.1:64606 2023-09-23 01:02:02,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:02,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x389d2e7f to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:02,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43a29147, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:02,163 DEBUG [hconnection-0x4b59aa46-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:02,166 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:02,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:02,173 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:02,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x389d2e7f to 127.0.0.1:64606 2023-09-23 01:02:02,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:02,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-23 01:02:02,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:02:02,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 01:02:02,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 01:02:02,180 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 01:02:02,181 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695431522181 2023-09-23 01:02:02,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-23 01:02:02,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-23 01:02:02,183 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:02:02,183 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:02:02,184 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-23 01:02:02,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 01:02:02,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-23 01:02:02,188 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 01:02:02,188 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695431522188 2023-09-23 01:02:02,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-23 01:02:02,204 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-23 01:02:02,204 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:02,205 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-23 01:02:02,205 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-23 01:02:02,206 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,206 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,207 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:02,207 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:02,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:02,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:02,207 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:02,207 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,208 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,208 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,209 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,209 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 01:02:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 01:02:02,210 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-23 01:02:02,210 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 01:02:02,210 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:02,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 01:02:02,211 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 01:02:02,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-23 01:02:02,211 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 01:02:02,211 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-23 01:02:02,211 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:02,211 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 01:02:02,212 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 01:02:02,211 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:02,212 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 01:02:02,212 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 01:02:02,213 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 01:02:02,213 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-23 01:02:02,213 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-23 01:02:02,213 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-23 01:02:02,216 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,216 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,216 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:02,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:02,216 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,217 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:02,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:02,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:02,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e6bd00[Count = 1] remaining members to acquire global barrier 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:02,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:02,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:02,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-23 01:02:02,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e6bd00[Count = 0] remaining members to acquire global barrier 2023-09-23 01:02:02,223 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-23 01:02:02,223 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,228 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 01:02:02,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 01:02:02,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:02:02,228 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,228 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-23 01:02:02,228 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:02,228 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. started... 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:02,228 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:02,228 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:02,229 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83c6cc1ae7498bcdb88e166c3e2921ee 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 01:02:02,229 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. started... 2023-09-23 01:02:02,229 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9b95fa1c6b0e320cb036d32f8e2df325 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 01:02:02,235 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 01:02:02,235 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:02,235 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 01:02:02,283 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:02,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 01:02:02,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:02,285 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:02:02,367 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309234214591f98584758ba3a654321068149 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309234214591f98584758ba3a654321068149 2023-09-23 01:02:02,367 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092318479c4aff7440ff80aa7af22457d129 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092318479c4aff7440ff80aa7af22457d129 2023-09-23 01:02:02,403 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/.tmp/cf/16881070d525417eb36d2c8cc5650af7 2023-09-23 01:02:02,405 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/.tmp/cf/7f56549cad2443ef87b977e11359f77a 2023-09-23 01:02:02,417 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/.tmp/cf/16881070d525417eb36d2c8cc5650af7 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf/16881070d525417eb36d2c8cc5650af7 2023-09-23 01:02:02,417 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/.tmp/cf/7f56549cad2443ef87b977e11359f77a as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf/7f56549cad2443ef87b977e11359f77a 2023-09-23 01:02:02,427 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf/7f56549cad2443ef87b977e11359f77a, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 01:02:02,427 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf/16881070d525417eb36d2c8cc5650af7, entries=48, sequenceid=6, filesize=13.0 K 2023-09-23 01:02:02,431 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 83c6cc1ae7498bcdb88e166c3e2921ee in 203ms, sequenceid=6, compaction requested=false 2023-09-23 01:02:02,431 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 9b95fa1c6b0e320cb036d32f8e2df325 in 202ms, sequenceid=6, compaction requested=false 2023-09-23 01:02:02,431 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-23 01:02:02,431 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-23 01:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9b95fa1c6b0e320cb036d32f8e2df325: 2023-09-23 01:02:02,434 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83c6cc1ae7498bcdb88e166c3e2921ee: 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf/7f56549cad2443ef87b977e11359f77a] hfiles 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf/16881070d525417eb36d2c8cc5650af7] hfiles 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf/7f56549cad2443ef87b977e11359f77a for snapshot=snaptb0-testExportWithTargetName 2023-09-23 01:02:02,435 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf/16881070d525417eb36d2c8cc5650af7 for snapshot=snaptb0-testExportWithTargetName 2023-09-23 01:02:02,460 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. completed. 2023-09-23 01:02:02,460 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 01:02:02,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:02:02,461 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. completed. 2023-09-23 01:02:02,461 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:02,461 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:02,461 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:02,461 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,461 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-23 01:02:02,461 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:02:02,463 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,463 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 01:02:02,463 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:02,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:02,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:02,463 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 01:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-23 01:02:02,464 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:02,464 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-23 01:02:02,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:02,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:02,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:02:02,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-23 01:02:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:02,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:02,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:02:02,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-23 01:02:02,474 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-23 01:02:02,474 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:02:02,474 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:02:02,474 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-23 01:02:02,474 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:02,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,477 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:02,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:02,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:02,476 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:02,477 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:02,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,478 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:02,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,481 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:02,481 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-23 01:02:02,482 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,485 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:02,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 01:02:02,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:02,493 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-23 01:02:02,494 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:02,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:02,495 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:02,496 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-23 01:02:02,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:02,495 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:02,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:02,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:02,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-23 01:02:02,497 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:02,497 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:02,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-23 01:02:02,497 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:02:02,497 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:02,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309234214591f98584758ba3a654321068149, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092318479c4aff7440ff80aa7af22457d129] mob files 2023-09-23 01:02:02,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309234214591f98584758ba3a654321068149 2023-09-23 01:02:02,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092318479c4aff7440ff80aa7af22457d129 2023-09-23 01:02:02,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-23 01:02:02,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-23 01:02:02,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,564 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-23 01:02:02,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695430922182Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695430922519 (+337 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695430922519Loading Region manifests for snaptb0-testExportWithTargetName at 1695430922519Writing data manifest for snaptb0-testExportWithTargetName at 1695430922530 (+11 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695430922551 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695430922564 (+13 ms) 2023-09-23 01:02:02,567 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-23 01:02:02,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 384 msec 2023-09-23 01:02:02,794 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:02,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-23 01:02:02,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:02:02,797 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797 2023-09-23 01:02:02,798 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36407, tgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797, rawTgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:02,846 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:02,847 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-631630462_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 01:02:02,847 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-23 01:02:02,866 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-23 01:02:02,939 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:02,939 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:02,940 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:02,940 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,852 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-2319430925252064799.jar 2023-09-23 01:02:03,853 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,853 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,922 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-8837068207429520506.jar 2023-09-23 01:02:03,922 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,923 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,923 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,924 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,924 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,925 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:03,925 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:02:03,925 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:02:03,926 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:02:03,926 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:02:03,927 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:02:03,928 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:02:03,928 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:02:03,929 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:02:03,930 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:02:03,931 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:02:03,936 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:03,936 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:03,937 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:03,937 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:03,938 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:03,939 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:03,939 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:04,806 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:02:04,812 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-23 01:02:04,820 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 01:02:05,273 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:05,275 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:05,556 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0001_000001 (auth:SIMPLE) 2023-09-23 01:02:06,514 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:02:09,906 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0001_000001 (auth:SIMPLE) 2023-09-23 01:02:12,182 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0001_000001 (auth:SIMPLE) 2023-09-23 01:02:15,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0001_000001 (auth:SIMPLE) 2023-09-23 01:02:17,708 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:02:17,711 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:02:17,723 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-23 01:02:17,723 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:02:17,724 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:02:17,724 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-23 01:02:17,724 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-23 01:02:17,725 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-23 01:02:17,725 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797/.hbase-snapshot/testExportWithTargetName 2023-09-23 01:02:17,725 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-23 01:02:17,725 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430922797/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-23 01:02:17,735 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-23 01:02:17,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-23 01:02:17,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:17,754 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430937754"}]},"ts":"1695430937754"} 2023-09-23 01:02:17,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 01:02:17,756 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-23 01:02:17,758 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-23 01:02:17,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, UNASSIGN}] 2023-09-23 01:02:17,762 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, UNASSIGN 2023-09-23 01:02:17,763 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, UNASSIGN 2023-09-23 01:02:17,763 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=83c6cc1ae7498bcdb88e166c3e2921ee, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:17,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9b95fa1c6b0e320cb036d32f8e2df325, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:17,764 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430937763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430937763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430937763"}]},"ts":"1695430937763"} 2023-09-23 01:02:17,764 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430937764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430937764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430937764"}]},"ts":"1695430937764"} 2023-09-23 01:02:17,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 83c6cc1ae7498bcdb88e166c3e2921ee, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:02:17,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 9b95fa1c6b0e320cb036d32f8e2df325, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:02:17,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 01:02:17,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:17,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83c6cc1ae7498bcdb88e166c3e2921ee, disabling compactions & flushes 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9b95fa1c6b0e320cb036d32f8e2df325, disabling compactions & flushes 2023-09-23 01:02:17,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:17,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. after waiting 0 ms 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. after waiting 0 ms 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:17,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:17,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:02:17,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:02:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:17,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:17,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325. 2023-09-23 01:02:17,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee. 2023-09-23 01:02:17,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9b95fa1c6b0e320cb036d32f8e2df325: 2023-09-23 01:02:17,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83c6cc1ae7498bcdb88e166c3e2921ee: 2023-09-23 01:02:17,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:17,950 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=9b95fa1c6b0e320cb036d32f8e2df325, regionState=CLOSED 2023-09-23 01:02:17,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:17,951 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430937950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430937950"}]},"ts":"1695430937950"} 2023-09-23 01:02:17,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=83c6cc1ae7498bcdb88e166c3e2921ee, regionState=CLOSED 2023-09-23 01:02:17,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695430937951"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430937951"}]},"ts":"1695430937951"} 2023-09-23 01:02:17,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-23 01:02:17,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 9b95fa1c6b0e320cb036d32f8e2df325, server=jenkins-hbase4.apache.org,40973,1695430912916 in 187 msec 2023-09-23 01:02:17,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-23 01:02:17,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 83c6cc1ae7498bcdb88e166c3e2921ee, server=jenkins-hbase4.apache.org,35139,1695430912822 in 188 msec 2023-09-23 01:02:17,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=9b95fa1c6b0e320cb036d32f8e2df325, UNASSIGN in 196 msec 2023-09-23 01:02:17,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-23 01:02:17,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=83c6cc1ae7498bcdb88e166c3e2921ee, UNASSIGN in 197 msec 2023-09-23 01:02:17,961 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430937961"}]},"ts":"1695430937961"} 2023-09-23 01:02:17,963 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-23 01:02:17,964 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-23 01:02:17,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 222 msec 2023-09-23 01:02:18,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-23 01:02:18,057 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-23 01:02:18,064 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-23 01:02:18,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:18,074 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:18,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-23 01:02:18,077 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:18,080 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-23 01:02:18,083 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:18,083 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:18,083 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 01:02:18,083 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 01:02:18,084 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 01:02:18,084 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-23 01:02:18,085 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,085 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 01:02:18,086 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 01:02:18,085 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,085 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 01:02:18,086 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 01:02:18,086 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 01:02:18,086 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 01:02:18,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-23 01:02:18,087 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 01:02:18,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 01:02:18,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/recovered.edits] 2023-09-23 01:02:18,091 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/recovered.edits] 2023-09-23 01:02:18,099 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf/7f56549cad2443ef87b977e11359f77a to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/cf/7f56549cad2443ef87b977e11359f77a 2023-09-23 01:02:18,099 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf/16881070d525417eb36d2c8cc5650af7 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/cf/16881070d525417eb36d2c8cc5650af7 2023-09-23 01:02:18,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee/recovered.edits/9.seqid 2023-09-23 01:02:18,104 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325/recovered.edits/9.seqid 2023-09-23 01:02:18,104 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/83c6cc1ae7498bcdb88e166c3e2921ee 2023-09-23 01:02:18,104 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportWithTargetName/9b95fa1c6b0e320cb036d32f8e2df325 2023-09-23 01:02:18,105 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-23 01:02:18,105 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 01:02:18,106 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-23 01:02:18,110 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309234214591f98584758ba3a654321068149 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309234214591f98584758ba3a654321068149 2023-09-23 01:02:18,112 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092318479c4aff7440ff80aa7af22457d129 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023092318479c4aff7440ff80aa7af22457d129 2023-09-23 01:02:18,112 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-23 01:02:18,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:18,137 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-23 01:02:18,140 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-23 01:02:18,141 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:18,141 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-23 01:02:18,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430938141"}]},"ts":"9223372036854775807"} 2023-09-23 01:02:18,142 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430938141"}]},"ts":"9223372036854775807"} 2023-09-23 01:02:18,144 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 01:02:18,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 83c6cc1ae7498bcdb88e166c3e2921ee, NAME => 'testtb-testExportWithTargetName,,1695430920523.83c6cc1ae7498bcdb88e166c3e2921ee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9b95fa1c6b0e320cb036d32f8e2df325, NAME => 'testtb-testExportWithTargetName,1,1695430920523.9b95fa1c6b0e320cb036d32f8e2df325.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 01:02:18,144 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-23 01:02:18,144 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695430938144"}]},"ts":"9223372036854775807"} 2023-09-23 01:02:18,146 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-23 01:02:18,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-23 01:02:18,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 83 msec 2023-09-23 01:02:18,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-23 01:02:18,193 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-23 01:02:18,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-23 01:02:18,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-23 01:02:18,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-23 01:02:18,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-23 01:02:18,250 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 706) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:46851 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:44819 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272192033_1 at /127.0.0.1:54940 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:54966 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_272192033_1 at /127.0.0.1:59376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:35809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:42200 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:59402 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 227) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=1514 (was 2296) 2023-09-23 01:02:18,250 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-23 01:02:18,271 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=172, AvailableMemoryMB=1513 2023-09-23 01:02:18,271 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-23 01:02:18,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 01:02:18,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:18,279 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:02:18,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-23 01:02:18,281 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:02:18,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 01:02:18,284 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,284 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,285 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 empty. 2023-09-23 01:02:18,285 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 empty. 2023-09-23 01:02:18,285 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,285 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,286 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 01:02:18,300 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 01:02:18,301 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3983be4cf39896d8965c7f28d9ba8e54, NAME => 'testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:02:18,301 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 35ed74af197ce2c32601882ea6079d98, NAME => 'testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:02:18,323 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:18,323 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:18,324 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3983be4cf39896d8965c7f28d9ba8e54, disabling compactions & flushes 2023-09-23 01:02:18,324 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 35ed74af197ce2c32601882ea6079d98, disabling compactions & flushes 2023-09-23 01:02:18,324 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,324 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,324 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,324 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,324 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. after waiting 0 ms 2023-09-23 01:02:18,325 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. after waiting 0 ms 2023-09-23 01:02:18,325 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,325 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,325 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,325 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,325 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 35ed74af197ce2c32601882ea6079d98: 2023-09-23 01:02:18,325 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3983be4cf39896d8965c7f28d9ba8e54: 2023-09-23 01:02:18,328 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:02:18,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430938329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430938329"}]},"ts":"1695430938329"} 2023-09-23 01:02:18,329 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430938329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430938329"}]},"ts":"1695430938329"} 2023-09-23 01:02:18,332 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:02:18,333 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:02:18,333 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430938333"}]},"ts":"1695430938333"} 2023-09-23 01:02:18,335 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 01:02:18,339 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:02:18,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:02:18,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:02:18,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:02:18,340 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:02:18,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, ASSIGN}] 2023-09-23 01:02:18,343 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, ASSIGN 2023-09-23 01:02:18,343 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, ASSIGN 2023-09-23 01:02:18,345 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:02:18,345 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:02:18,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 01:02:18,495 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:02:18,498 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3983be4cf39896d8965c7f28d9ba8e54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,498 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=35ed74af197ce2c32601882ea6079d98, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,498 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430938497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430938497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430938497"}]},"ts":"1695430938497"} 2023-09-23 01:02:18,498 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430938497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430938497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430938497"}]},"ts":"1695430938497"} 2023-09-23 01:02:18,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 35ed74af197ce2c32601882ea6079d98, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:02:18,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 3983be4cf39896d8965c7f28d9ba8e54, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:02:18,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 01:02:18,657 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 35ed74af197ce2c32601882ea6079d98, NAME => 'testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 01:02:18,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3983be4cf39896d8965c7f28d9ba8e54, NAME => 'testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 01:02:18,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. service=AccessControlService 2023-09-23 01:02:18,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. service=AccessControlService 2023-09-23 01:02:18,659 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,660 INFO [StoreOpener-35ed74af197ce2c32601882ea6079d98-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,661 INFO [StoreOpener-3983be4cf39896d8965c7f28d9ba8e54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,662 DEBUG [StoreOpener-35ed74af197ce2c32601882ea6079d98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf 2023-09-23 01:02:18,662 DEBUG [StoreOpener-35ed74af197ce2c32601882ea6079d98-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf 2023-09-23 01:02:18,663 DEBUG [StoreOpener-3983be4cf39896d8965c7f28d9ba8e54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf 2023-09-23 01:02:18,663 DEBUG [StoreOpener-3983be4cf39896d8965c7f28d9ba8e54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf 2023-09-23 01:02:18,663 INFO [StoreOpener-3983be4cf39896d8965c7f28d9ba8e54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3983be4cf39896d8965c7f28d9ba8e54 columnFamilyName cf 2023-09-23 01:02:18,663 INFO [StoreOpener-35ed74af197ce2c32601882ea6079d98-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 35ed74af197ce2c32601882ea6079d98 columnFamilyName cf 2023-09-23 01:02:18,665 INFO [StoreOpener-3983be4cf39896d8965c7f28d9ba8e54-1] regionserver.HStore(310): Store=3983be4cf39896d8965c7f28d9ba8e54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:02:18,666 INFO [StoreOpener-35ed74af197ce2c32601882ea6079d98-1] regionserver.HStore(310): Store=35ed74af197ce2c32601882ea6079d98/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:02:18,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:18,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:18,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:02:18,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:02:18,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 35ed74af197ce2c32601882ea6079d98; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64078063, jitterRate=-0.04516245424747467}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:02:18,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 35ed74af197ce2c32601882ea6079d98: 2023-09-23 01:02:18,675 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3983be4cf39896d8965c7f28d9ba8e54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71213128, jitterRate=0.06115829944610596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:02:18,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3983be4cf39896d8965c7f28d9ba8e54: 2023-09-23 01:02:18,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98., pid=30, masterSystemTime=1695430938654 2023-09-23 01:02:18,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54., pid=31, masterSystemTime=1695430938655 2023-09-23 01:02:18,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,680 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3983be4cf39896d8965c7f28d9ba8e54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430938679"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430938679"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430938679"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430938679"}]},"ts":"1695430938679"} 2023-09-23 01:02:18,681 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=35ed74af197ce2c32601882ea6079d98, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,681 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430938680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430938680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430938680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430938680"}]},"ts":"1695430938680"} 2023-09-23 01:02:18,685 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-23 01:02:18,686 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 3983be4cf39896d8965c7f28d9ba8e54, server=jenkins-hbase4.apache.org,40973,1695430912916 in 180 msec 2023-09-23 01:02:18,688 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-23 01:02:18,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 35ed74af197ce2c32601882ea6079d98, server=jenkins-hbase4.apache.org,35139,1695430912822 in 183 msec 2023-09-23 01:02:18,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, ASSIGN in 346 msec 2023-09-23 01:02:18,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-23 01:02:18,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, ASSIGN in 352 msec 2023-09-23 01:02:18,695 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:02:18,696 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430938695"}]},"ts":"1695430938695"} 2023-09-23 01:02:18,698 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 01:02:18,701 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:02:18,701 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-23 01:02:18,703 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 01:02:18,705 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,705 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,705 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,705 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:18,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:18,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:18,707 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:18,708 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:18,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 432 msec 2023-09-23 01:02:18,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-23 01:02:18,885 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-23 01:02:18,888 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 01:02:18,888 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,891 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:18,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:02:18,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430938905 (current time:1695430938905). 2023-09-23 01:02:18,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:02:18,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x134ceedd to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:18,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25973b3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:18,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:18,917 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:18,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x134ceedd to 127.0.0.1:64606 2023-09-23 01:02:18,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:18,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3643ab57 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:18,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@420d9144, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:18,926 DEBUG [hconnection-0x5edf3cd4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:18,929 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37522, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:18,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:18,935 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:18,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3643ab57 to 127.0.0.1:64606 2023-09-23 01:02:18,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:18,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 01:02:18,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:02:18,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:02:18,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:02:18,941 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:02:18,942 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695431538942 2023-09-23 01:02:18,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 01:02:18,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:02:18,943 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:02:18,943 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:02:18,944 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:02:18,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 01:02:18,947 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-23 01:02:18,948 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 01:02:18,948 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695431538948 2023-09-23 01:02:18,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,963 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-23 01:02:18,963 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:18,965 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 01:02:18,965 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 01:02:18,965 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,965 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,966 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:18,967 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:18,967 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:18,966 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:18,967 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:18,967 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,968 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,968 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 01:02:18,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 01:02:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 01:02:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,969 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:18,969 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 01:02:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 01:02:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 01:02:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 01:02:18,970 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-23 01:02:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,970 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 01:02:18,971 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:18,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 01:02:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 01:02:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 01:02:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 01:02:18,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 01:02:18,972 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 01:02:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-23 01:02:18,973 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-23 01:02:18,974 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,974 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:18,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:18,980 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,980 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,980 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:18,981 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,981 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:18,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76caae03[Count = 1] remaining members to acquire global barrier 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:18,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:18,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-23 01:02:18,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76caae03[Count = 0] remaining members to acquire global barrier 2023-09-23 01:02:18,985 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 01:02:18,985 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:02:18,986 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 01:02:18,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:02:18,987 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:02:18,986 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:02:18,987 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:18,987 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:02:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 01:02:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:18,988 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 01:02:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:18,990 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:18,990 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:18,990 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:18,990 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. started... 2023-09-23 01:02:18,991 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. started... 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3983be4cf39896d8965c7f28d9ba8e54: 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 35ed74af197ce2c32601882ea6079d98: 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:18,992 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:02:19,012 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. completed. 2023-09-23 01:02:19,012 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 01:02:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:02:19,012 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. completed. 2023-09-23 01:02:19,012 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:19,012 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-23 01:02:19,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:02:19,015 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 01:02:19,015 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,015 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,015 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 01:02:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 01:02:19,016 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,016 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-23 01:02:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:02:19,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 01:02:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:02:19,026 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 01:02:19,026 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-23 01:02:19,026 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:02:19,026 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:02:19,026 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,026 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:02:19,027 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,027 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,027 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,027 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,027 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,027 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,028 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,028 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,029 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,030 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,032 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,032 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,032 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,035 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,035 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,037 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,037 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,036 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 01:02:19,036 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:02:19,037 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,038 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,038 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,038 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,038 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 01:02:19,038 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,044 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:19,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:02:19,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:19,046 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:02:19,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,086 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,087 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 01:02:19,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,087 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:19,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695430938942Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695430939047 (+105 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695430939047Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695430939047Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695430939051 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695430939079 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695430939087 (+8 ms) 2023-09-23 01:02:19,090 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 01:02:19,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 147 msec 2023-09-23 01:02:19,246 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:19,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:02:19,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:02:19,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40973] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:02:19,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35139] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:02:19,258 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-23 01:02:19,258 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:19,258 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:19,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:02:19,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430939271 (current time:1695430939271). 2023-09-23 01:02:19,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:02:19,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x11e0e1ba to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:19,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@942f2d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:19,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:19,286 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:19,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11e0e1ba to 127.0.0.1:64606 2023-09-23 01:02:19,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:19,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x6e232d8c to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:19,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66126d45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:19,297 DEBUG [hconnection-0xb192ae0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:19,298 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:19,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:19,303 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:19,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e232d8c to 127.0.0.1:64606 2023-09-23 01:02:19,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:19,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 01:02:19,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:02:19,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:02:19,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:02:19,310 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:02:19,311 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695431539311 2023-09-23 01:02:19,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:02:19,311 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-23 01:02:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:02:19,312 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:02:19,314 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:02:19,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 01:02:19,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-23 01:02:19,317 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 01:02:19,318 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695431539318 2023-09-23 01:02:19,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-23 01:02:19,336 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-23 01:02:19,336 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:19,338 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-23 01:02:19,338 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-23 01:02:19,338 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,338 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,340 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,340 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,340 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,340 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,341 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,341 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,341 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,341 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,342 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-23 01:02:19,342 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 01:02:19,342 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:19,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 01:02:19,343 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 01:02:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 01:02:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 01:02:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:19,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-23 01:02:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 01:02:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-23 01:02:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:19,344 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 01:02:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-23 01:02:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 01:02:19,345 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-23 01:02:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 01:02:19,346 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-23 01:02:19,348 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,349 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,349 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,349 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:19,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f01367[Count = 1] remaining members to acquire global barrier 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-23 01:02:19,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42f01367[Count = 0] remaining members to acquire global barrier 2023-09-23 01:02:19,354 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 01:02:19,354 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,355 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:02:19,355 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:02:19,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:02:19,356 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:19,356 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:02:19,356 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. started... 2023-09-23 01:02:19,356 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:19,356 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3983be4cf39896d8965c7f28d9ba8e54 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-23 01:02:19,356 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:19,356 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:02:19,356 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. started... 2023-09-23 01:02:19,357 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 35ed74af197ce2c32601882ea6079d98 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-23 01:02:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 01:02:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,359 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 01:02:19,399 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923c4d5d096018f4a06a33c7d1734a94ec2 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230923c4d5d096018f4a06a33c7d1734a94ec2 2023-09-23 01:02:19,402 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923e510237fdc7e4dbe9e95c9c0c850f0b3 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923e510237fdc7e4dbe9e95c9c0c850f0b3 2023-09-23 01:02:19,414 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:19,416 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/.tmp/cf/67cb7cb5c52442da8d42e73d3dc1636f 2023-09-23 01:02:19,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:02:19,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:19,417 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:02:19,423 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/.tmp/cf/67cb7cb5c52442da8d42e73d3dc1636f as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf/67cb7cb5c52442da8d42e73d3dc1636f 2023-09-23 01:02:19,424 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/.tmp/cf/1b780c1cd08148409a0b9b8c7fc430ae 2023-09-23 01:02:19,429 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf/67cb7cb5c52442da8d42e73d3dc1636f, entries=5, sequenceid=6, filesize=5.7 K 2023-09-23 01:02:19,430 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 3983be4cf39896d8965c7f28d9ba8e54 in 74ms, sequenceid=6, compaction requested=false 2023-09-23 01:02:19,430 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-23 01:02:19,431 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/.tmp/cf/1b780c1cd08148409a0b9b8c7fc430ae as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf/1b780c1cd08148409a0b9b8c7fc430ae 2023-09-23 01:02:19,431 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3983be4cf39896d8965c7f28d9ba8e54: 2023-09-23 01:02:19,431 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 01:02:19,431 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:19,431 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf/67cb7cb5c52442da8d42e73d3dc1636f] hfiles 2023-09-23 01:02:19,431 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf/67cb7cb5c52442da8d42e73d3dc1636f for snapshot=snaptb0-testExportFileSystemState 2023-09-23 01:02:19,437 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf/1b780c1cd08148409a0b9b8c7fc430ae, entries=45, sequenceid=6, filesize=12.5 K 2023-09-23 01:02:19,438 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 35ed74af197ce2c32601882ea6079d98 in 82ms, sequenceid=6, compaction requested=false 2023-09-23 01:02:19,445 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 35ed74af197ce2c32601882ea6079d98: 2023-09-23 01:02:19,446 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 01:02:19,446 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:19,446 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf/1b780c1cd08148409a0b9b8c7fc430ae] hfiles 2023-09-23 01:02:19,446 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf/1b780c1cd08148409a0b9b8c7fc430ae for snapshot=snaptb0-testExportFileSystemState 2023-09-23 01:02:19,449 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. completed. 2023-09-23 01:02:19,449 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:19,449 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:19,449 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:19,449 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 01:02:19,450 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:02:19,454 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 01:02:19,454 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,454 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,455 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 01:02:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,458 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. completed. 2023-09-23 01:02:19,458 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:19,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,458 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:19,459 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:19,459 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,459 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-23 01:02:19,459 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:02:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,460 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-23 01:02:19,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,460 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-23 01:02:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:02:19,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 01:02:19,467 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-23 01:02:19,467 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:02:19,467 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:02:19,467 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-23 01:02:19,467 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,475 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,476 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:19,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,476 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,477 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:19,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,479 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:19,479 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-23 01:02:19,480 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:19,483 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:19,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:19,484 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:19,484 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,484 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:19,484 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:19,484 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-23 01:02:19,486 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,486 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-23 01:02:19,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,486 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:19,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:19,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-23 01:02:19,486 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:02:19,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:19,486 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:19,487 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,487 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923e510237fdc7e4dbe9e95c9c0c850f0b3, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230923c4d5d096018f4a06a33c7d1734a94ec2] mob files 2023-09-23 01:02:19,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923e510237fdc7e4dbe9e95c9c0c850f0b3 2023-09-23 01:02:19,487 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230923c4d5d096018f4a06a33c7d1734a94ec2 2023-09-23 01:02:19,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-23 01:02:19,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,575 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-23 01:02:19,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695430939311Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695430939500 (+189 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695430939500Loading Region manifests for snaptb0-testExportFileSystemState at 1695430939500Writing data manifest for snaptb0-testExportFileSystemState at 1695430939505 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695430939564 (+59 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695430939576 (+12 ms) 2023-09-23 01:02:19,579 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-23 01:02:19,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 267 msec 2023-09-23 01:02:19,618 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:19,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:02:19,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:02:19,619 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619 2023-09-23 01:02:19,620 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36407, tgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619, rawTgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:19,645 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:19,646 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1955494167_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,646 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-23 01:02:19,661 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-23 01:02:19,692 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:19,693 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:19,693 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:19,693 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,580 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-1785182928737598635.jar 2023-09-23 01:02:20,581 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,581 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,648 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-3528931335028163906.jar 2023-09-23 01:02:20,649 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,649 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,649 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,650 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,650 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:20,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:02:20,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:02:20,652 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:02:20,652 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:02:20,653 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:02:20,653 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:02:20,654 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:02:20,654 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:02:20,654 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:02:20,655 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:02:20,655 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:20,656 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:20,656 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:20,657 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:20,657 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:20,657 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:20,658 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:21,146 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:02:21,149 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-23 01:02:21,151 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-23 01:02:22,161 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:22,161 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:22,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0001_000001 (auth:SIMPLE) 2023-09-23 01:02:22,543 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0002_000001 (auth:SIMPLE) 2023-09-23 01:02:23,541 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:02:26,597 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0002_000001 (auth:SIMPLE) 2023-09-23 01:02:28,827 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0002_000001 (auth:SIMPLE) 2023-09-23 01:02:31,959 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0002_000001 (auth:SIMPLE) 2023-09-23 01:02:33,340 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:02:33,341 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:02:33,349 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-23 01:02:33,349 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:02:33,350 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:02:33,350 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 01:02:33,350 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 01:02:33,351 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 01:02:33,351 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-23 01:02:33,351 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-23 01:02:33,351 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430939619/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-23 01:02:33,358 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-23 01:02:33,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-23 01:02:33,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 01:02:33,364 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430953364"}]},"ts":"1695430953364"} 2023-09-23 01:02:33,366 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 01:02:33,367 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-23 01:02:33,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, UNASSIGN}] 2023-09-23 01:02:33,371 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, UNASSIGN 2023-09-23 01:02:33,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, UNASSIGN 2023-09-23 01:02:33,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3983be4cf39896d8965c7f28d9ba8e54, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:33,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430953372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430953372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430953372"}]},"ts":"1695430953372"} 2023-09-23 01:02:33,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=35ed74af197ce2c32601882ea6079d98, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:33,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430953372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430953372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430953372"}]},"ts":"1695430953372"} 2023-09-23 01:02:33,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 3983be4cf39896d8965c7f28d9ba8e54, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:02:33,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 35ed74af197ce2c32601882ea6079d98, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:02:33,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 01:02:33,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:33,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3983be4cf39896d8965c7f28d9ba8e54, disabling compactions & flushes 2023-09-23 01:02:33,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:33,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:33,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. after waiting 0 ms 2023-09-23 01:02:33,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:33,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 35ed74af197ce2c32601882ea6079d98, disabling compactions & flushes 2023-09-23 01:02:33,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. after waiting 0 ms 2023-09-23 01:02:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:33,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:02:33,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:02:33,538 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:33,539 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54. 2023-09-23 01:02:33,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3983be4cf39896d8965c7f28d9ba8e54: 2023-09-23 01:02:33,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:02:33,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98. 2023-09-23 01:02:33,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 35ed74af197ce2c32601882ea6079d98: 2023-09-23 01:02:33,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:33,543 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3983be4cf39896d8965c7f28d9ba8e54, regionState=CLOSED 2023-09-23 01:02:33,543 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430953543"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430953543"}]},"ts":"1695430953543"} 2023-09-23 01:02:33,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:33,544 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=35ed74af197ce2c32601882ea6079d98, regionState=CLOSED 2023-09-23 01:02:33,544 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695430953544"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430953544"}]},"ts":"1695430953544"} 2023-09-23 01:02:33,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-23 01:02:33,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 3983be4cf39896d8965c7f28d9ba8e54, server=jenkins-hbase4.apache.org,40973,1695430912916 in 172 msec 2023-09-23 01:02:33,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-23 01:02:33,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 35ed74af197ce2c32601882ea6079d98, server=jenkins-hbase4.apache.org,35139,1695430912822 in 172 msec 2023-09-23 01:02:33,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3983be4cf39896d8965c7f28d9ba8e54, UNASSIGN in 180 msec 2023-09-23 01:02:33,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-23 01:02:33,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=35ed74af197ce2c32601882ea6079d98, UNASSIGN in 181 msec 2023-09-23 01:02:33,552 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430953552"}]},"ts":"1695430953552"} 2023-09-23 01:02:33,554 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 01:02:33,555 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-23 01:02:33,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 197 msec 2023-09-23 01:02:33,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-23 01:02:33,667 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-23 01:02:33,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-23 01:02:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,671 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-23 01:02:33,672 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,674 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-23 01:02:33,677 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,677 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,678 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,677 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 01:02:33,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 01:02:33,678 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 01:02:33,678 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:33,679 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:33,679 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:33,680 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:33,679 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:33,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 01:02:33,682 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/recovered.edits] 2023-09-23 01:02:33,682 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/recovered.edits] 2023-09-23 01:02:33,687 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf/67cb7cb5c52442da8d42e73d3dc1636f to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/cf/67cb7cb5c52442da8d42e73d3dc1636f 2023-09-23 01:02:33,687 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf/1b780c1cd08148409a0b9b8c7fc430ae to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/cf/1b780c1cd08148409a0b9b8c7fc430ae 2023-09-23 01:02:33,690 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54/recovered.edits/9.seqid 2023-09-23 01:02:33,690 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98/recovered.edits/9.seqid 2023-09-23 01:02:33,691 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/3983be4cf39896d8965c7f28d9ba8e54 2023-09-23 01:02:33,691 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemState/35ed74af197ce2c32601882ea6079d98 2023-09-23 01:02:33,691 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-23 01:02:33,692 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 01:02:33,692 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-23 01:02:33,696 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923e510237fdc7e4dbe9e95c9c0c850f0b3 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230923e510237fdc7e4dbe9e95c9c0c850f0b3 2023-09-23 01:02:33,698 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230923c4d5d096018f4a06a33c7d1734a94ec2 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230923c4d5d096018f4a06a33c7d1734a94ec2 2023-09-23 01:02:33,698 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-23 01:02:33,701 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,704 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-23 01:02:33,706 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-23 01:02:33,708 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,708 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-23 01:02:33,708 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430953708"}]},"ts":"9223372036854775807"} 2023-09-23 01:02:33,709 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430953708"}]},"ts":"9223372036854775807"} 2023-09-23 01:02:33,711 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 01:02:33,711 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3983be4cf39896d8965c7f28d9ba8e54, NAME => 'testtb-testExportFileSystemState,,1695430938273.3983be4cf39896d8965c7f28d9ba8e54.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 35ed74af197ce2c32601882ea6079d98, NAME => 'testtb-testExportFileSystemState,1,1695430938273.35ed74af197ce2c32601882ea6079d98.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 01:02:33,711 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-23 01:02:33,711 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695430953711"}]},"ts":"9223372036854775807"} 2023-09-23 01:02:33,713 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-23 01:02:33,715 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-23 01:02:33,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 47 msec 2023-09-23 01:02:33,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-23 01:02:33,783 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-23 01:02:33,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-23 01:02:33,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-23 01:02:33,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-23 01:02:33,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-23 01:02:33,819 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 756) Potentially hanging thread: Thread-2080 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:41844 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:33411 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:38063 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:50204 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_908151643_1 at /127.0.0.1:54632 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_908151643_1 at /127.0.0.1:41802 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:54650 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=936 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=323 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=1342 (was 1513) 2023-09-23 01:02:33,819 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 01:02:33,838 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=936, MaxFileDescriptor=60000, SystemLoadAverage=323, ProcessCount=172, AvailableMemoryMB=1342 2023-09-23 01:02:33,838 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-23 01:02:33,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 01:02:33,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:02:33,844 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:02:33,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-23 01:02:33,845 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:02:33,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 01:02:33,848 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:33,848 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:33,848 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 empty. 2023-09-23 01:02:33,848 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 empty. 2023-09-23 01:02:33,849 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:33,849 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:33,849 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 01:02:33,861 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-23 01:02:33,862 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0a3510eb3e8af00b2eadaf7ab78b6016, NAME => 'testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:02:33,862 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 780d3cdfbfa9cde459d20fdda276dfd8, NAME => 'testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:02:33,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:33,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 780d3cdfbfa9cde459d20fdda276dfd8, disabling compactions & flushes 2023-09-23 01:02:33,879 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:33,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:33,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. after waiting 0 ms 2023-09-23 01:02:33,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:33,879 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:33,879 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 780d3cdfbfa9cde459d20fdda276dfd8: 2023-09-23 01:02:33,881 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:33,882 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0a3510eb3e8af00b2eadaf7ab78b6016, disabling compactions & flushes 2023-09-23 01:02:33,882 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:33,882 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:33,882 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. after waiting 0 ms 2023-09-23 01:02:33,882 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:33,882 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:33,882 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0a3510eb3e8af00b2eadaf7ab78b6016: 2023-09-23 01:02:33,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:02:33,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430953885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430953885"}]},"ts":"1695430953885"} 2023-09-23 01:02:33,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430953885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430953885"}]},"ts":"1695430953885"} 2023-09-23 01:02:33,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:02:33,888 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:02:33,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430953889"}]},"ts":"1695430953889"} 2023-09-23 01:02:33,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-23 01:02:33,894 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:02:33,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:02:33,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:02:33,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:02:33,895 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:02:33,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, ASSIGN}] 2023-09-23 01:02:33,898 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, ASSIGN 2023-09-23 01:02:33,898 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, ASSIGN 2023-09-23 01:02:33,899 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:02:33,899 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:02:33,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 01:02:34,049 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:02:34,052 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=780d3cdfbfa9cde459d20fdda276dfd8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0a3510eb3e8af00b2eadaf7ab78b6016, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,052 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430954052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430954052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430954052"}]},"ts":"1695430954052"} 2023-09-23 01:02:34,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430954052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430954052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430954052"}]},"ts":"1695430954052"} 2023-09-23 01:02:34,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 780d3cdfbfa9cde459d20fdda276dfd8, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:02:34,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 0a3510eb3e8af00b2eadaf7ab78b6016, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:02:34,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 01:02:34,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 780d3cdfbfa9cde459d20fdda276dfd8, NAME => 'testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 01:02:34,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0a3510eb3e8af00b2eadaf7ab78b6016, NAME => 'testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 01:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. service=AccessControlService 2023-09-23 01:02:34,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. service=AccessControlService 2023-09-23 01:02:34,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:02:34,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,212 INFO [StoreOpener-0a3510eb3e8af00b2eadaf7ab78b6016-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,212 INFO [StoreOpener-780d3cdfbfa9cde459d20fdda276dfd8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,214 DEBUG [StoreOpener-0a3510eb3e8af00b2eadaf7ab78b6016-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf 2023-09-23 01:02:34,214 DEBUG [StoreOpener-0a3510eb3e8af00b2eadaf7ab78b6016-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf 2023-09-23 01:02:34,214 DEBUG [StoreOpener-780d3cdfbfa9cde459d20fdda276dfd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf 2023-09-23 01:02:34,214 DEBUG [StoreOpener-780d3cdfbfa9cde459d20fdda276dfd8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf 2023-09-23 01:02:34,214 INFO [StoreOpener-0a3510eb3e8af00b2eadaf7ab78b6016-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0a3510eb3e8af00b2eadaf7ab78b6016 columnFamilyName cf 2023-09-23 01:02:34,214 INFO [StoreOpener-780d3cdfbfa9cde459d20fdda276dfd8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 780d3cdfbfa9cde459d20fdda276dfd8 columnFamilyName cf 2023-09-23 01:02:34,216 INFO [StoreOpener-0a3510eb3e8af00b2eadaf7ab78b6016-1] regionserver.HStore(310): Store=0a3510eb3e8af00b2eadaf7ab78b6016/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:02:34,216 INFO [StoreOpener-780d3cdfbfa9cde459d20fdda276dfd8-1] regionserver.HStore(310): Store=780d3cdfbfa9cde459d20fdda276dfd8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:02:34,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:02:34,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:02:34,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:02:34,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:02:34,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0a3510eb3e8af00b2eadaf7ab78b6016; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63782198, jitterRate=-0.04957118630409241}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:02:34,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 780d3cdfbfa9cde459d20fdda276dfd8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73712596, jitterRate=0.09840327501296997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:02:34,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0a3510eb3e8af00b2eadaf7ab78b6016: 2023-09-23 01:02:34,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 780d3cdfbfa9cde459d20fdda276dfd8: 2023-09-23 01:02:34,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8., pid=45, masterSystemTime=1695430954206 2023-09-23 01:02:34,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016., pid=46, masterSystemTime=1695430954207 2023-09-23 01:02:34,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=780d3cdfbfa9cde459d20fdda276dfd8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,226 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430954226"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430954226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430954226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430954226"}]},"ts":"1695430954226"} 2023-09-23 01:02:34,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,227 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0a3510eb3e8af00b2eadaf7ab78b6016, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,227 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430954227"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430954227"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430954227"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430954227"}]},"ts":"1695430954227"} 2023-09-23 01:02:34,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-23 01:02:34,230 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 780d3cdfbfa9cde459d20fdda276dfd8, server=jenkins-hbase4.apache.org,35139,1695430912822 in 174 msec 2023-09-23 01:02:34,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-23 01:02:34,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 0a3510eb3e8af00b2eadaf7ab78b6016, server=jenkins-hbase4.apache.org,40973,1695430912916 in 174 msec 2023-09-23 01:02:34,232 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, ASSIGN in 335 msec 2023-09-23 01:02:34,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-23 01:02:34,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, ASSIGN in 336 msec 2023-09-23 01:02:34,235 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:02:34,235 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430954235"}]},"ts":"1695430954235"} 2023-09-23 01:02:34,236 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-23 01:02:34,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:02:34,239 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-23 01:02:34,240 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 01:02:34,242 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:34,242 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:34,242 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:34,242 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:02:34,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:34,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:34,243 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:34,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-23 01:02:34,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 403 msec 2023-09-23 01:02:34,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-23 01:02:34,449 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-23 01:02:34,451 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 01:02:34,452 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,453 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:34,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 01:02:34,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430954468 (current time:1695430954468). 2023-09-23 01:02:34,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:02:34,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x0e11286f to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:34,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17dd1e16, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:34,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:34,482 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39174, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:34,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e11286f to 127.0.0.1:64606 2023-09-23 01:02:34,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:34,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x4b44b159 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:34,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c91ba0e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:34,492 DEBUG [hconnection-0x33432024-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:34,495 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39182, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:34,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:34,502 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45178, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:34,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b44b159 to 127.0.0.1:64606 2023-09-23 01:02:34,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:34,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 01:02:34,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:02:34,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 01:02:34,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 01:02:34,508 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 01:02:34,509 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695431554509 2023-09-23 01:02:34,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 01:02:34,509 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 01:02:34,510 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:02:34,510 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:02:34,511 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 01:02:34,515 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 01:02:34,516 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-09-23 01:02:34,517 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 01:02:34,518 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695431554518 2023-09-23 01:02:34,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,534 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-23 01:02:34,535 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,536 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 01:02:34,536 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 01:02:34,538 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,538 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,540 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,540 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,540 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,540 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,541 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,541 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,541 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,541 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,541 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,542 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 01:02:34,542 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,542 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 01:02:34,543 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 01:02:34,543 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 01:02:34,543 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 01:02:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 01:02:34,543 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 01:02:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 01:02:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 01:02:34,544 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 01:02:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-23 01:02:34,549 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-23 01:02:34,550 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,550 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,550 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,551 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:34,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,551 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3148e82[Count = 1] remaining members to acquire global barrier 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-23 01:02:34,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3148e82[Count = 0] remaining members to acquire global barrier 2023-09-23 01:02:34,555 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 01:02:34,555 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,556 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,556 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,556 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,557 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 01:02:34,557 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:34,557 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,557 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. started... 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 01:02:34,557 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:34,557 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:34,557 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,557 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a3510eb3e8af00b2eadaf7ab78b6016: 2023-09-23 01:02:34,558 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. started... 2023-09-23 01:02:34,558 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,559 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 780d3cdfbfa9cde459d20fdda276dfd8: 2023-09-23 01:02:34,560 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:34,560 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:02:34,560 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,560 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:34,560 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:02:34,571 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. completed. 2023-09-23 01:02:34,571 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. completed. 2023-09-23 01:02:34,571 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,571 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,571 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:34,571 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:34,571 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,571 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:34,572 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 01:02:34,575 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 01:02:34,575 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,575 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:34,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,575 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 01:02:34,576 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 01:02:34,576 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:34,576 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,576 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-23 01:02:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 01:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:02:34,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 01:02:34,583 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-23 01:02:34,583 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:02:34,583 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:02:34,583 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,583 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:02:34,585 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,585 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,586 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,586 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,586 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:34,586 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,587 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:34,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:34,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,588 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,588 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,592 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,592 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,592 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,597 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:34,597 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:34,598 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:02:34,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:34,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:34,599 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:34,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:34,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:34,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:34,600 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,600 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,600 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 01:02:34,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,610 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:34,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 01:02:34,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:34,612 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:02:34,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,626 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 01:02:34,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,627 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-23 01:02:34,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695430954509Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695430954608 (+99 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695430954608Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695430954608Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695430954612 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695430954620 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695430954626 (+6 ms) 2023-09-23 01:02:34,630 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 01:02:34,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 120 msec 2023-09-23 01:02:34,812 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:34,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 01:02:34,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:02:34,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40973] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:02:34,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35139] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:02:34,822 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-23 01:02:34,822 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,822 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:02:34,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 01:02:34,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430954835 (current time:1695430954835). 2023-09-23 01:02:34,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:02:34,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x34b5f047 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:34,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52d09b81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:34,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:34,852 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:34,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34b5f047 to 127.0.0.1:64606 2023-09-23 01:02:34,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:34,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3ad2752e to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:02:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21fe8dfb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:02:34,867 DEBUG [hconnection-0x772416d6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:34,870 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:34,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:02:34,877 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:02:34,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ad2752e to 127.0.0.1:64606 2023-09-23 01:02:34,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:02:34,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-23 01:02:34,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:02:34,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 01:02:34,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 01:02:34,882 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 01:02:34,883 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695431554883 2023-09-23 01:02:34,883 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-23 01:02:34,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-23 01:02:34,884 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:02:34,884 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:02:34,884 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 01:02:34,885 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-23 01:02:34,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-23 01:02:34,887 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 01:02:34,887 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695431554887 2023-09-23 01:02:34,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-23 01:02:34,898 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-23 01:02:34,898 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,899 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-23 01:02:34,899 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-23 01:02:34,900 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,900 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,901 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,901 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,901 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,901 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:34,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,901 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:34,902 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:34,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,902 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,902 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:02:34,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 01:02:34,903 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 01:02:34,903 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 01:02:34,905 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 01:02:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-23 01:02:34,905 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 01:02:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,905 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 01:02:34,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 01:02:34,906 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-23 01:02:34,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 01:02:34,906 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 01:02:34,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-23 01:02:34,906 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,906 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-23 01:02:34,907 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:02:34,907 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 01:02:34,908 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-23 01:02:34,908 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 01:02:34,908 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-23 01:02:34,908 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 01:02:34,909 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-23 01:02:34,909 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,909 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,909 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:34,910 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,910 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,910 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,910 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,910 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:34,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,913 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 01:02:34,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7215be27[Count = 1] remaining members to acquire global barrier 2023-09-23 01:02:34,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,913 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,913 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:02:34,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:34,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-23 01:02:34,915 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7215be27[Count = 0] remaining members to acquire global barrier 2023-09-23 01:02:34,915 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-23 01:02:34,915 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 01:02:34,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,918 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,918 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:34,918 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:34,918 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 01:02:34,918 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. started... 2023-09-23 01:02:34,918 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:02:34,918 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. started... 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:02:34,918 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:02:34,919 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0a3510eb3e8af00b2eadaf7ab78b6016 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-23 01:02:34,919 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 780d3cdfbfa9cde459d20fdda276dfd8 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-23 01:02:34,921 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 01:02:34,921 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:34,921 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 01:02:34,954 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923cbfda9372e024a9e8e731e95b979632d to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbfda9372e024a9e8e731e95b979632d 2023-09-23 01:02:34,968 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/.tmp/cf/8060269178bd470c86616bd8a02eb302 2023-09-23 01:02:34,973 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/.tmp/cf/8060269178bd470c86616bd8a02eb302 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf/8060269178bd470c86616bd8a02eb302 2023-09-23 01:02:34,977 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf/8060269178bd470c86616bd8a02eb302, entries=47, sequenceid=6, filesize=12.7 K 2023-09-23 01:02:34,978 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 780d3cdfbfa9cde459d20fdda276dfd8 in 59ms, sequenceid=6, compaction requested=false 2023-09-23 01:02:34,978 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-23 01:02:34,979 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 780d3cdfbfa9cde459d20fdda276dfd8: 2023-09-23 01:02:34,979 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 01:02:34,979 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:34,979 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf/8060269178bd470c86616bd8a02eb302] hfiles 2023-09-23 01:02:34,979 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf/8060269178bd470c86616bd8a02eb302 for snapshot=snaptb0-testConsecutiveExports 2023-09-23 01:02:34,984 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:34,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 01:02:34,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:34,986 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. completed. 2023-09-23 01:02:34,986 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:02:34,986 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 01:02:34,986 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:02:34,988 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 01:02:34,988 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,988 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:34,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:34,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:34,988 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 01:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:34,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:34,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:34,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:02:34,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-23 01:02:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:35,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 01:02:35,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:02:35,187 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-23 01:02:35,348 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923ef7e53c804d74f52a9e82494b934821b to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923ef7e53c804d74f52a9e82494b934821b 2023-09-23 01:02:35,355 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/.tmp/cf/5aaad1a2595f45699c8f316fe456e93e 2023-09-23 01:02:35,361 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/.tmp/cf/5aaad1a2595f45699c8f316fe456e93e as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf/5aaad1a2595f45699c8f316fe456e93e 2023-09-23 01:02:35,365 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf/5aaad1a2595f45699c8f316fe456e93e, entries=3, sequenceid=6, filesize=5.4 K 2023-09-23 01:02:35,366 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 0a3510eb3e8af00b2eadaf7ab78b6016 in 447ms, sequenceid=6, compaction requested=false 2023-09-23 01:02:35,368 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0a3510eb3e8af00b2eadaf7ab78b6016: 2023-09-23 01:02:35,368 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 01:02:35,368 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:02:35,368 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf/5aaad1a2595f45699c8f316fe456e93e] hfiles 2023-09-23 01:02:35,368 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf/5aaad1a2595f45699c8f316fe456e93e for snapshot=snaptb0-testConsecutiveExports 2023-09-23 01:02:35,375 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. completed. 2023-09-23 01:02:35,375 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:02:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:02:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:02:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-23 01:02:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:02:35,377 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,377 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-23 01:02:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:35,377 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:35,377 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-23 01:02:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:02:35,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-23 01:02:35,382 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-23 01:02:35,382 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:02:35,382 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:02:35,382 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-23 01:02:35,382 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:02:35,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:35,384 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:35,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:02:35,385 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:02:35,386 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:35,386 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:02:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,389 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:02:35,389 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-23 01:02:35,390 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:35,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:35,396 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:02:35,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-23 01:02:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,396 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:02:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:35,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:02:35,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:02:35,398 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:35,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:35,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:02:35,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:02:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,399 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbfda9372e024a9e8e731e95b979632d, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923ef7e53c804d74f52a9e82494b934821b] mob files 2023-09-23 01:02:35,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbfda9372e024a9e8e731e95b979632d 2023-09-23 01:02:35,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923ef7e53c804d74f52a9e82494b934821b 2023-09-23 01:02:35,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-23 01:02:35,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-23 01:02:35,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,431 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695430954883Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695430955411 (+528 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695430955411Loading Region manifests for snaptb0-testConsecutiveExports at 1695430955411Writing data manifest for snaptb0-testConsecutiveExports at 1695430955415 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695430955423 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695430955430 (+7 ms) 2023-09-23 01:02:35,433 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-23 01:02:35,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 550 msec 2023-09-23 01:02:35,488 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:02:35,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-23 01:02:35,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:02:35,489 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489 2023-09-23 01:02:35,489 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:35,511 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:35,511 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@275a6da9, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,511 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 01:02:35,520 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:35,532 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:35,532 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:35,533 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:35,533 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-2429390056158238873.jar 2023-09-23 01:02:36,411 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,412 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,479 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-6702969864742355564.jar 2023-09-23 01:02:36,479 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,480 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,480 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,481 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,481 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,481 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:36,482 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:02:36,482 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:02:36,482 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:02:36,483 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:02:36,483 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:02:36,484 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:02:36,484 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:02:36,484 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:02:36,485 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:02:36,485 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:02:36,486 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:36,486 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:36,487 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:36,487 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:36,487 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:36,488 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:36,488 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:36,864 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:02:36,867 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 01:02:36,869 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 01:02:38,130 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:38,130 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:38,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0002_000001 (auth:SIMPLE) 2023-09-23 01:02:38,932 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0003_000001 (auth:SIMPLE) 2023-09-23 01:02:39,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:02:42,688 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0003_000001 (auth:SIMPLE) 2023-09-23 01:02:44,905 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0003_000001 (auth:SIMPLE) 2023-09-23 01:02:47,217 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0003_000001 (auth:SIMPLE) 2023-09-23 01:02:49,037 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:02:49,037 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:02:49,041 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 01:02:49,041 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:02:49,042 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:02:49,042 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 01:02:49,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 01:02:49,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 01:02:49,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@37faad50 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 01:02:49,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 01:02:49,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 01:02:49,047 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:49,071 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:02:49,071 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@10c53335, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:49,071 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-23 01:02:49,083 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-23 01:02:49,095 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:49,096 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:49,096 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:49,097 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:49,971 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-1932882460398094620.jar 2023-09-23 01:02:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:49,972 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,039 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-237103883909167222.jar 2023-09-23 01:02:50,039 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,039 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,040 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,040 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,041 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,041 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:02:50,041 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:02:50,042 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:02:50,042 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:02:50,042 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:02:50,043 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:02:50,043 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:02:50,044 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:02:50,044 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:02:50,044 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:02:50,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:02:50,045 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:50,046 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:50,046 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:50,047 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:50,047 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:02:50,047 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:50,048 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:02:50,390 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:02:50,392 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-23 01:02:50,394 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-23 01:02:53,385 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:53,385 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:02:53,387 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0003_000001 (auth:SIMPLE) 2023-09-23 01:02:54,142 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0004_000001 (auth:SIMPLE) 2023-09-23 01:02:57,810 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0004_000001 (auth:SIMPLE) 2023-09-23 01:03:00,019 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0004_000001 (auth:SIMPLE) 2023-09-23 01:03:02,271 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0004_000001 (auth:SIMPLE) 2023-09-23 01:03:03,551 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:03:03,551 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:03:03,554 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-23 01:03:03,554 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:03:03,555 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:03:03,555 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 01:03:03,558 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 01:03:03,559 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 01:03:03,559 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@37faad50 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-23 01:03:03,559 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-23 01:03:03,559 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/local-export-1695430955489/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-23 01:03:03,571 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-23 01:03:03,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-23 01:03:03,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 01:03:03,575 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430983575"}]},"ts":"1695430983575"} 2023-09-23 01:03:03,577 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-23 01:03:03,578 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-23 01:03:03,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, UNASSIGN}] 2023-09-23 01:03:03,580 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, UNASSIGN 2023-09-23 01:03:03,581 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, UNASSIGN 2023-09-23 01:03:03,581 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0a3510eb3e8af00b2eadaf7ab78b6016, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:03,581 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=780d3cdfbfa9cde459d20fdda276dfd8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:03,581 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430983581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430983581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430983581"}]},"ts":"1695430983581"} 2023-09-23 01:03:03,581 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430983581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430983581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430983581"}]},"ts":"1695430983581"} 2023-09-23 01:03:03,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 0a3510eb3e8af00b2eadaf7ab78b6016, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:03,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 780d3cdfbfa9cde459d20fdda276dfd8, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:03,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 01:03:03,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:03:03,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0a3510eb3e8af00b2eadaf7ab78b6016, disabling compactions & flushes 2023-09-23 01:03:03,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:03:03,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:03:03,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. after waiting 0 ms 2023-09-23 01:03:03,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:03:03,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:03:03,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 780d3cdfbfa9cde459d20fdda276dfd8, disabling compactions & flushes 2023-09-23 01:03:03,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:03:03,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:03:03,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. after waiting 0 ms 2023-09-23 01:03:03,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:03:03,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:03,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:03,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:03,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016. 2023-09-23 01:03:03,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0a3510eb3e8af00b2eadaf7ab78b6016: 2023-09-23 01:03:03,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:03,756 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8. 2023-09-23 01:03:03,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 780d3cdfbfa9cde459d20fdda276dfd8: 2023-09-23 01:03:03,757 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:03:03,758 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0a3510eb3e8af00b2eadaf7ab78b6016, regionState=CLOSED 2023-09-23 01:03:03,758 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430983758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430983758"}]},"ts":"1695430983758"} 2023-09-23 01:03:03,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:03:03,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=780d3cdfbfa9cde459d20fdda276dfd8, regionState=CLOSED 2023-09-23 01:03:03,759 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695430983758"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430983758"}]},"ts":"1695430983758"} 2023-09-23 01:03:03,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-23 01:03:03,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 0a3510eb3e8af00b2eadaf7ab78b6016, server=jenkins-hbase4.apache.org,40973,1695430912916 in 176 msec 2023-09-23 01:03:03,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-23 01:03:03,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0a3510eb3e8af00b2eadaf7ab78b6016, UNASSIGN in 182 msec 2023-09-23 01:03:03,762 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 780d3cdfbfa9cde459d20fdda276dfd8, server=jenkins-hbase4.apache.org,35139,1695430912822 in 177 msec 2023-09-23 01:03:03,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-23 01:03:03,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=780d3cdfbfa9cde459d20fdda276dfd8, UNASSIGN in 183 msec 2023-09-23 01:03:03,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430983764"}]},"ts":"1695430983764"} 2023-09-23 01:03:03,765 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-23 01:03:03,768 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-23 01:03:03,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 197 msec 2023-09-23 01:03:03,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-23 01:03:03,877 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-23 01:03:03,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-23 01:03:03,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,881 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-23 01:03:03,882 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,884 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-23 01:03:03,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 01:03:03,888 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:03:03,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 01:03:03,888 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:03:03,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:03,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:03,889 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-23 01:03:03,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:03,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 01:03:03,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/recovered.edits] 2023-09-23 01:03:03,890 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/recovered.edits] 2023-09-23 01:03:03,894 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf/5aaad1a2595f45699c8f316fe456e93e to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/cf/5aaad1a2595f45699c8f316fe456e93e 2023-09-23 01:03:03,894 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf/8060269178bd470c86616bd8a02eb302 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/cf/8060269178bd470c86616bd8a02eb302 2023-09-23 01:03:03,897 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016/recovered.edits/9.seqid 2023-09-23 01:03:03,897 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8/recovered.edits/9.seqid 2023-09-23 01:03:03,898 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/0a3510eb3e8af00b2eadaf7ab78b6016 2023-09-23 01:03:03,898 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testConsecutiveExports/780d3cdfbfa9cde459d20fdda276dfd8 2023-09-23 01:03:03,898 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-23 01:03:03,898 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 01:03:03,899 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-23 01:03:03,903 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbfda9372e024a9e8e731e95b979632d to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230923cbfda9372e024a9e8e731e95b979632d 2023-09-23 01:03:03,904 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923ef7e53c804d74f52a9e82494b934821b to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230923ef7e53c804d74f52a9e82494b934821b 2023-09-23 01:03:03,905 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-23 01:03:03,907 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,910 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-23 01:03:03,912 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-23 01:03:03,913 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,913 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-23 01:03:03,913 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430983913"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:03,913 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430983913"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:03,915 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 01:03:03,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0a3510eb3e8af00b2eadaf7ab78b6016, NAME => 'testtb-testConsecutiveExports,,1695430953840.0a3510eb3e8af00b2eadaf7ab78b6016.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 780d3cdfbfa9cde459d20fdda276dfd8, NAME => 'testtb-testConsecutiveExports,1,1695430953840.780d3cdfbfa9cde459d20fdda276dfd8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 01:03:03,915 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-23 01:03:03,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695430983915"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:03,917 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-23 01:03:03,919 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-23 01:03:03,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 42 msec 2023-09-23 01:03:03,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-23 01:03:03,991 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-23 01:03:03,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-23 01:03:04,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-23 01:03:04,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-23 01:03:04,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-23 01:03:04,027 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=904 (was 936), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 323), ProcessCount=169 (was 172), AvailableMemoryMB=1124 (was 1342) 2023-09-23 01:03:04,027 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-23 01:03:04,045 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=217, ProcessCount=169, AvailableMemoryMB=1123 2023-09-23 01:03:04,045 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-09-23 01:03:04,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 01:03:04,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:03:04,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-23 01:03:04,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:03:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 01:03:04,053 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,053 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,054 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 empty. 2023-09-23 01:03:04,054 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 empty. 2023-09-23 01:03:04,054 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,054 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,054 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 01:03:04,063 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-23 01:03:04,065 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => c63c21656440f0f581aa8904a5213c63, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:04,065 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 19f0c4d7d11d7eeedaa767abc933de04, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:04,074 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing c63c21656440f0f581aa8904a5213c63, disabling compactions & flushes 2023-09-23 01:03:04,075 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. after waiting 0 ms 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,075 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for c63c21656440f0f581aa8904a5213c63: 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 19f0c4d7d11d7eeedaa767abc933de04, disabling compactions & flushes 2023-09-23 01:03:04,075 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. after waiting 0 ms 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,075 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,075 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 19f0c4d7d11d7eeedaa767abc933de04: 2023-09-23 01:03:04,077 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:03:04,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695430984078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430984078"}]},"ts":"1695430984078"} 2023-09-23 01:03:04,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695430984078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430984078"}]},"ts":"1695430984078"} 2023-09-23 01:03:04,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:03:04,085 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:03:04,085 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430984085"}]},"ts":"1695430984085"} 2023-09-23 01:03:04,087 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-23 01:03:04,090 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:03:04,091 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:03:04,091 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:03:04,091 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:03:04,091 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:03:04,091 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, ASSIGN}] 2023-09-23 01:03:04,093 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, ASSIGN 2023-09-23 01:03:04,093 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, ASSIGN 2023-09-23 01:03:04,094 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34471,1695430912871; forceNewPlan=false, retain=false 2023-09-23 01:03:04,094 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:03:04,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 01:03:04,244 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:03:04,247 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=19f0c4d7d11d7eeedaa767abc933de04, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c63c21656440f0f581aa8904a5213c63, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,247 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695430984247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430984247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430984247"}]},"ts":"1695430984247"} 2023-09-23 01:03:04,247 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695430984247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430984247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430984247"}]},"ts":"1695430984247"} 2023-09-23 01:03:04,248 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 19f0c4d7d11d7eeedaa767abc933de04, server=jenkins-hbase4.apache.org,34471,1695430912871}] 2023-09-23 01:03:04,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure c63c21656440f0f581aa8904a5213c63, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:04,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 01:03:04,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 19f0c4d7d11d7eeedaa767abc933de04, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. service=AccessControlService 2023-09-23 01:03:04,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c63c21656440f0f581aa8904a5213c63, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. service=AccessControlService 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,406 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:04,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,407 INFO [StoreOpener-19f0c4d7d11d7eeedaa767abc933de04-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,408 INFO [StoreOpener-c63c21656440f0f581aa8904a5213c63-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,409 DEBUG [StoreOpener-19f0c4d7d11d7eeedaa767abc933de04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf 2023-09-23 01:03:04,409 DEBUG [StoreOpener-19f0c4d7d11d7eeedaa767abc933de04-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf 2023-09-23 01:03:04,409 DEBUG [StoreOpener-c63c21656440f0f581aa8904a5213c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf 2023-09-23 01:03:04,409 DEBUG [StoreOpener-c63c21656440f0f581aa8904a5213c63-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf 2023-09-23 01:03:04,410 INFO [StoreOpener-19f0c4d7d11d7eeedaa767abc933de04-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 19f0c4d7d11d7eeedaa767abc933de04 columnFamilyName cf 2023-09-23 01:03:04,410 INFO [StoreOpener-c63c21656440f0f581aa8904a5213c63-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c63c21656440f0f581aa8904a5213c63 columnFamilyName cf 2023-09-23 01:03:04,412 INFO [StoreOpener-c63c21656440f0f581aa8904a5213c63-1] regionserver.HStore(310): Store=c63c21656440f0f581aa8904a5213c63/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:04,412 INFO [StoreOpener-19f0c4d7d11d7eeedaa767abc933de04-1] regionserver.HStore(310): Store=19f0c4d7d11d7eeedaa767abc933de04/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:04,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:04,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:04,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:04,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c63c21656440f0f581aa8904a5213c63; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61828287, jitterRate=-0.07868672907352448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c63c21656440f0f581aa8904a5213c63: 2023-09-23 01:03:04,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 19f0c4d7d11d7eeedaa767abc933de04; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70967896, jitterRate=0.05750405788421631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:04,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 19f0c4d7d11d7eeedaa767abc933de04: 2023-09-23 01:03:04,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63., pid=61, masterSystemTime=1695430984401 2023-09-23 01:03:04,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04., pid=60, masterSystemTime=1695430984400 2023-09-23 01:03:04,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,422 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=c63c21656440f0f581aa8904a5213c63, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,422 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695430984422"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430984422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430984422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430984422"}]},"ts":"1695430984422"} 2023-09-23 01:03:04,423 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=19f0c4d7d11d7eeedaa767abc933de04, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,423 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695430984423"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430984423"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430984423"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430984423"}]},"ts":"1695430984423"} 2023-09-23 01:03:04,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-23 01:03:04,426 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure c63c21656440f0f581aa8904a5213c63, server=jenkins-hbase4.apache.org,40973,1695430912916 in 175 msec 2023-09-23 01:03:04,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-23 01:03:04,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, ASSIGN in 335 msec 2023-09-23 01:03:04,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 19f0c4d7d11d7eeedaa767abc933de04, server=jenkins-hbase4.apache.org,34471,1695430912871 in 177 msec 2023-09-23 01:03:04,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=58, resume processing ppid=57 2023-09-23 01:03:04,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, ASSIGN in 336 msec 2023-09-23 01:03:04,430 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:03:04,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430984430"}]},"ts":"1695430984430"} 2023-09-23 01:03:04,431 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-23 01:03:04,433 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:03:04,433 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-23 01:03:04,435 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 01:03:04,437 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:04,437 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:04,437 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:04,437 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:04,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:04,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:04,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:04,439 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:04,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 392 msec 2023-09-23 01:03:04,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-23 01:03:04,654 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-23 01:03:04,656 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,657 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,659 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:03:04,666 DEBUG [hconnection-0x60d85d60-shared-pool-22] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,669 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 01:03:04,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430984674 (current time:1695430984674). 2023-09-23 01:03:04,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:04,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x62dde2b0 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:04,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16b0149, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:04,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,684 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62dde2b0 to 127.0.0.1:64606 2023-09-23 01:03:04,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:04,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x16823b67 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:04,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b478365, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:04,693 DEBUG [hconnection-0x42ffb80d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,694 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,699 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x16823b67 to 127.0.0.1:64606 2023-09-23 01:03:04,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:04,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 01:03:04,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:04,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 01:03:04,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 01:03:04,704 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 01:03:04,705 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695431584705 2023-09-23 01:03:04,705 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 01:03:04,706 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:04,706 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:04,707 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 01:03:04,707 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 01:03:04,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 01:03:04,709 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 01:03:04,709 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695431584709 2023-09-23 01:03:04,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,718 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 01:03:04,718 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,719 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 01:03:04,719 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 01:03:04,719 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,719 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,720 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,720 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,721 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,720 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,721 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,721 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,721 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,721 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 01:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 01:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 01:03:04,723 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,723 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 01:03:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 01:03:04,722 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 01:03:04,725 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 01:03:04,725 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 01:03:04,724 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 01:03:04,725 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 01:03:04,725 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 01:03:04,725 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 01:03:04,726 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,726 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,728 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,728 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:04,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@518cbcd0[Count = 1] remaining members to acquire global barrier 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 01:03:04,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@518cbcd0[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:04,732 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 01:03:04,732 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 01:03:04,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,733 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:04,733 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,733 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 01:03:04,733 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. started... 2023-09-23 01:03:04,734 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 01:03:04,733 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:04,734 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,734 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:04,733 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 01:03:04,734 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19f0c4d7d11d7eeedaa767abc933de04: 2023-09-23 01:03:04,734 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:04,734 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:04,734 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:04,734 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,734 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,734 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. started... 2023-09-23 01:03:04,734 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:04,734 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:03:04,735 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c63c21656440f0f581aa8904a5213c63: 2023-09-23 01:03:04,735 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,735 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:04,735 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:03:04,741 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 01:03:04,741 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,741 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 01:03:04,745 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. completed. 2023-09-23 01:03:04,745 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:04,746 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. completed. 2023-09-23 01:03:04,746 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 01:03:04,746 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 01:03:04,747 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,747 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 01:03:04,748 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,748 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 01:03:04,748 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,748 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 01:03:04,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34471,1695430912871': 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:03:04,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 01:03:04,755 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 01:03:04,756 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:04,756 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:04,756 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,756 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:04,758 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,758 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,758 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,758 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,758 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,758 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,759 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,759 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,759 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,760 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,761 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,762 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,762 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,765 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,765 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,767 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,767 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,767 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:03:04,767 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,767 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 01:03:04,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,775 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 01:03:04,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,799 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695430984705Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695430984775 (+70 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695430984775Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695430984775Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695430984781 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695430984793 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695430984798 (+5 ms) 2023-09-23 01:03:04,801 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 01:03:04,802 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 96 msec 2023-09-23 01:03:04,806 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:04,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 01:03:04,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:04,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34471] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:03:04,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40973] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:03:04,813 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,813 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,813 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:03:04,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 01:03:04,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430984823 (current time:1695430984823). 2023-09-23 01:03:04,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:04,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x0cf953ff to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:04,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f6ec19b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:04,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,832 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cf953ff to 127.0.0.1:64606 2023-09-23 01:03:04,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:04,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x07c7150f to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:04,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e7d8a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:04,841 DEBUG [hconnection-0x488cab1d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,844 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:04,850 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:04,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07c7150f to 127.0.0.1:64606 2023-09-23 01:03:04,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:04,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-23 01:03:04,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:04,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 01:03:04,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 01:03:04,855 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 01:03:04,856 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695431584856 2023-09-23 01:03:04,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-23 01:03:04,857 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:04,857 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:04,858 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-23 01:03:04,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 01:03:04,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-23 01:03:04,860 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 01:03:04,860 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695431584860 2023-09-23 01:03:04,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,869 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-23 01:03:04,869 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,870 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-23 01:03:04,870 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-23 01:03:04,870 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,870 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,872 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,872 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,872 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,872 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,872 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,872 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,873 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 01:03:04,873 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-23 01:03:04,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,874 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 01:03:04,874 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,874 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 01:03:04,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,875 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:04,876 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 01:03:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 01:03:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-23 01:03:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-23 01:03:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 01:03:04,877 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-23 01:03:04,878 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,878 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,879 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:04,879 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,880 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1325f6ad[Count = 1] remaining members to acquire global barrier 2023-09-23 01:03:04,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-23 01:03:04,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1325f6ad[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:04,883 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-23 01:03:04,883 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,884 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,884 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,884 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 01:03:04,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,885 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 01:03:04,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:04,885 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,885 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. started... 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:04,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,885 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,885 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:04,885 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c63c21656440f0f581aa8904a5213c63 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-23 01:03:04,885 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-23 01:03:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:04,886 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,886 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. started... 2023-09-23 01:03:04,886 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 19f0c4d7d11d7eeedaa767abc933de04 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-23 01:03:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 01:03:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,886 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 01:03:04,905 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923651088231d9f464390ff01f8df56cf29 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923651088231d9f464390ff01f8df56cf29 2023-09-23 01:03:04,906 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230923b79146d4d904403887dd501f485cfce3 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923b79146d4d904403887dd501f485cfce3 2023-09-23 01:03:04,915 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/.tmp/cf/4f089e833ca44612ad2a5f28cd5989b7 2023-09-23 01:03:04,916 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/.tmp/cf/91afc4e0244447018b97206255112ddb 2023-09-23 01:03:04,921 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/.tmp/cf/91afc4e0244447018b97206255112ddb as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf/91afc4e0244447018b97206255112ddb 2023-09-23 01:03:04,921 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/.tmp/cf/4f089e833ca44612ad2a5f28cd5989b7 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf/4f089e833ca44612ad2a5f28cd5989b7 2023-09-23 01:03:04,925 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf/91afc4e0244447018b97206255112ddb, entries=4, sequenceid=6, filesize=5.6 K 2023-09-23 01:03:04,926 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf/4f089e833ca44612ad2a5f28cd5989b7, entries=46, sequenceid=6, filesize=13.3 K 2023-09-23 01:03:04,926 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 19f0c4d7d11d7eeedaa767abc933de04 in 40ms, sequenceid=6, compaction requested=false 2023-09-23 01:03:04,926 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-23 01:03:04,927 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for c63c21656440f0f581aa8904a5213c63 in 42ms, sequenceid=6, compaction requested=false 2023-09-23 01:03:04,927 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-23 01:03:04,929 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 19f0c4d7d11d7eeedaa767abc933de04: 2023-09-23 01:03:04,929 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c63c21656440f0f581aa8904a5213c63: 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf/91afc4e0244447018b97206255112ddb] hfiles 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf/4f089e833ca44612ad2a5f28cd5989b7] hfiles 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf/4f089e833ca44612ad2a5f28cd5989b7 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,930 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf/91afc4e0244447018b97206255112ddb for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,937 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. completed. 2023-09-23 01:03:04,937 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:04,937 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. completed. 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,937 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-23 01:03:04,937 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:04,939 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 01:03:04,939 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-23 01:03:04,939 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,939 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,939 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 01:03:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,939 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,941 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,941 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-23 01:03:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:03:04,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34471,1695430912871': 2023-09-23 01:03:04,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-23 01:03:04,949 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-23 01:03:04,949 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:04,949 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:04,949 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,949 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,957 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:04,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,958 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,958 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 01:03:04,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:03:04,959 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:03:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,960 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:04,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,961 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:04,962 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,962 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,964 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,964 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,964 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,965 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:04,964 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:04,964 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,966 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,965 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:04,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,965 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:04,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,966 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:04,966 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:03:04,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:04,967 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,968 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923651088231d9f464390ff01f8df56cf29, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923b79146d4d904403887dd501f485cfce3] mob files 2023-09-23 01:03:04,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923651088231d9f464390ff01f8df56cf29 2023-09-23 01:03:04,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923b79146d4d904403887dd501f485cfce3 2023-09-23 01:03:04,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,993 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-23 01:03:04,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,994 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:04,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695430984856Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695430984975 (+119 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695430984975Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695430984975Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695430984978 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695430984985 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695430984993 (+8 ms) 2023-09-23 01:03:04,996 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-23 01:03:04,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 139 msec 2023-09-23 01:03:05,159 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:05,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-23 01:03:05,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:05,188 DEBUG [Listener at jenkins-hbase4.apache.org/33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 01:03:05,191 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 01:03:05,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34471] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 01:03:05,193 DEBUG [Listener at jenkins-hbase4.apache.org/33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 01:03:05,198 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 01:03:05,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35139] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 01:03:05,198 DEBUG [Listener at jenkins-hbase4.apache.org/33411] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-23 01:03:05,202 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-23 01:03:05,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40973] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-23 01:03:05,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-23 01:03:05,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:05,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:03:05,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-23 01:03:05,207 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:03:05,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 01:03:05,209 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,209 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,210 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b empty. 2023-09-23 01:03:05,210 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a empty. 2023-09-23 01:03:05,210 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,210 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,210 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 01:03:05,219 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-23 01:03:05,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6487a1be79e293e0be794ac021d2fe1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:05,221 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 631dbab607ad15b6810cddd392d3aa0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 6487a1be79e293e0be794ac021d2fe1a, disabling compactions & flushes 2023-09-23 01:03:05,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. after waiting 0 ms 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 6487a1be79e293e0be794ac021d2fe1a: 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 631dbab607ad15b6810cddd392d3aa0b, disabling compactions & flushes 2023-09-23 01:03:05,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. after waiting 0 ms 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,229 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,229 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 631dbab607ad15b6810cddd392d3aa0b: 2023-09-23 01:03:05,231 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:03:05,232 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430985232"}]},"ts":"1695430985232"} 2023-09-23 01:03:05,232 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430985232"}]},"ts":"1695430985232"} 2023-09-23 01:03:05,234 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:03:05,235 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:03:05,235 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430985235"}]},"ts":"1695430985235"} 2023-09-23 01:03:05,236 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-23 01:03:05,240 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:03:05,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:03:05,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:03:05,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:03:05,241 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:03:05,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, ASSIGN}] 2023-09-23 01:03:05,244 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, ASSIGN 2023-09-23 01:03:05,244 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, ASSIGN 2023-09-23 01:03:05,244 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:03:05,245 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:03:05,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 01:03:05,395 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:03:05,397 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=631dbab607ad15b6810cddd392d3aa0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:05,397 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6487a1be79e293e0be794ac021d2fe1a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:05,398 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430985397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430985397"}]},"ts":"1695430985397"} 2023-09-23 01:03:05,398 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985397"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430985397"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430985397"}]},"ts":"1695430985397"} 2023-09-23 01:03:05,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 631dbab607ad15b6810cddd392d3aa0b, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:05,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 6487a1be79e293e0be794ac021d2fe1a, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:05,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 01:03:05,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6487a1be79e293e0be794ac021d2fe1a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.', STARTKEY => '2', ENDKEY => ''} 2023-09-23 01:03:05,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 631dbab607ad15b6810cddd392d3aa0b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.', STARTKEY => '', ENDKEY => '2'} 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. service=AccessControlService 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. service=AccessControlService 2023-09-23 01:03:05,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:05,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,558 INFO [StoreOpener-6487a1be79e293e0be794ac021d2fe1a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,558 INFO [StoreOpener-631dbab607ad15b6810cddd392d3aa0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,559 DEBUG [StoreOpener-631dbab607ad15b6810cddd392d3aa0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf 2023-09-23 01:03:05,559 DEBUG [StoreOpener-631dbab607ad15b6810cddd392d3aa0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf 2023-09-23 01:03:05,559 DEBUG [StoreOpener-6487a1be79e293e0be794ac021d2fe1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf 2023-09-23 01:03:05,559 DEBUG [StoreOpener-6487a1be79e293e0be794ac021d2fe1a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf 2023-09-23 01:03:05,559 INFO [StoreOpener-631dbab607ad15b6810cddd392d3aa0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 631dbab607ad15b6810cddd392d3aa0b columnFamilyName cf 2023-09-23 01:03:05,560 INFO [StoreOpener-6487a1be79e293e0be794ac021d2fe1a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6487a1be79e293e0be794ac021d2fe1a columnFamilyName cf 2023-09-23 01:03:05,560 INFO [StoreOpener-631dbab607ad15b6810cddd392d3aa0b-1] regionserver.HStore(310): Store=631dbab607ad15b6810cddd392d3aa0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:05,560 INFO [StoreOpener-6487a1be79e293e0be794ac021d2fe1a-1] regionserver.HStore(310): Store=6487a1be79e293e0be794ac021d2fe1a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:05,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,561 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:05,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:05,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:05,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 631dbab607ad15b6810cddd392d3aa0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64736831, jitterRate=-0.03534604609012604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:05,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 631dbab607ad15b6810cddd392d3aa0b: 2023-09-23 01:03:05,566 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6487a1be79e293e0be794ac021d2fe1a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63792365, jitterRate=-0.04941968619823456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:05,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6487a1be79e293e0be794ac021d2fe1a: 2023-09-23 01:03:05,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a., pid=70, masterSystemTime=1695430985551 2023-09-23 01:03:05,567 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b., pid=69, masterSystemTime=1695430985551 2023-09-23 01:03:05,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:05,570 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=631dbab607ad15b6810cddd392d3aa0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:05,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:05,570 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430985570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430985570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430985570"}]},"ts":"1695430985570"} 2023-09-23 01:03:05,571 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6487a1be79e293e0be794ac021d2fe1a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:05,571 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985570"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430985570"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430985570"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430985570"}]},"ts":"1695430985570"} 2023-09-23 01:03:05,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-23 01:03:05,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 631dbab607ad15b6810cddd392d3aa0b, server=jenkins-hbase4.apache.org,40973,1695430912916 in 173 msec 2023-09-23 01:03:05,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-23 01:03:05,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 6487a1be79e293e0be794ac021d2fe1a, server=jenkins-hbase4.apache.org,35139,1695430912822 in 173 msec 2023-09-23 01:03:05,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, ASSIGN in 333 msec 2023-09-23 01:03:05,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-23 01:03:05,576 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, ASSIGN in 333 msec 2023-09-23 01:03:05,577 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:03:05,577 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430985577"}]},"ts":"1695430985577"} 2023-09-23 01:03:05,578 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-23 01:03:05,580 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:03:05,580 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-23 01:03:05,582 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 01:03:05,583 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:05,583 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:05,583 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:05,583 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:05,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:05,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 381 msec 2023-09-23 01:03:05,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-23 01:03:05,811 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-23 01:03:05,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 631dbab607ad15b6810cddd392d3aa0b, 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:05,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[631dbab607ad15b6810cddd392d3aa0b, 6487a1be79e293e0be794ac021d2fe1a], force=true 2023-09-23 01:03:05,844 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[631dbab607ad15b6810cddd392d3aa0b, 6487a1be79e293e0be794ac021d2fe1a], force=true 2023-09-23 01:03:05,844 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[631dbab607ad15b6810cddd392d3aa0b, 6487a1be79e293e0be794ac021d2fe1a], force=true 2023-09-23 01:03:05,844 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[631dbab607ad15b6810cddd392d3aa0b, 6487a1be79e293e0be794ac021d2fe1a], force=true 2023-09-23 01:03:05,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 01:03:05,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, UNASSIGN}] 2023-09-23 01:03:05,867 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, UNASSIGN 2023-09-23 01:03:05,868 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, UNASSIGN 2023-09-23 01:03:05,868 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=631dbab607ad15b6810cddd392d3aa0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:05,868 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6487a1be79e293e0be794ac021d2fe1a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:05,868 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430985868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430985868"}]},"ts":"1695430985868"} 2023-09-23 01:03:05,868 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430985868"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430985868"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430985868"}]},"ts":"1695430985868"} 2023-09-23 01:03:05,870 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 631dbab607ad15b6810cddd392d3aa0b, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:05,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 6487a1be79e293e0be794ac021d2fe1a, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:05,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 01:03:06,022 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:06,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 631dbab607ad15b6810cddd392d3aa0b, disabling compactions & flushes 2023-09-23 01:03:06,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:06,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:06,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. after waiting 0 ms 2023-09-23 01:03:06,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:06,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 631dbab607ad15b6810cddd392d3aa0b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 01:03:06,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:06,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6487a1be79e293e0be794ac021d2fe1a, disabling compactions & flushes 2023-09-23 01:03:06,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:06,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:06,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. after waiting 0 ms 2023-09-23 01:03:06,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:06,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6487a1be79e293e0be794ac021d2fe1a 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-23 01:03:06,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/.tmp/cf/7169322d14184712bec948767c859601 2023-09-23 01:03:06,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/.tmp/cf/1d47f4397a0d408da48fb7e2d62a1062 2023-09-23 01:03:06,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/.tmp/cf/7169322d14184712bec948767c859601 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf/7169322d14184712bec948767c859601 2023-09-23 01:03:06,054 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/.tmp/cf/1d47f4397a0d408da48fb7e2d62a1062 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf/1d47f4397a0d408da48fb7e2d62a1062 2023-09-23 01:03:06,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf/7169322d14184712bec948767c859601, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 01:03:06,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf/1d47f4397a0d408da48fb7e2d62a1062, entries=1, sequenceid=5, filesize=4.7 K 2023-09-23 01:03:06,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 631dbab607ad15b6810cddd392d3aa0b in 35ms, sequenceid=5, compaction requested=false 2023-09-23 01:03:06,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 01:03:06,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6487a1be79e293e0be794ac021d2fe1a in 34ms, sequenceid=5, compaction requested=false 2023-09-23 01:03:06,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 01:03:06,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 01:03:06,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-23 01:03:06,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:06,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:06,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a. 2023-09-23 01:03:06,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b. 2023-09-23 01:03:06,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6487a1be79e293e0be794ac021d2fe1a: 2023-09-23 01:03:06,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 631dbab607ad15b6810cddd392d3aa0b: 2023-09-23 01:03:06,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:06,071 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=631dbab607ad15b6810cddd392d3aa0b, regionState=CLOSED 2023-09-23 01:03:06,071 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430986071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430986071"}]},"ts":"1695430986071"} 2023-09-23 01:03:06,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:06,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6487a1be79e293e0be794ac021d2fe1a, regionState=CLOSED 2023-09-23 01:03:06,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695430986071"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430986071"}]},"ts":"1695430986071"} 2023-09-23 01:03:06,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-23 01:03:06,074 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 631dbab607ad15b6810cddd392d3aa0b, server=jenkins-hbase4.apache.org,40973,1695430912916 in 202 msec 2023-09-23 01:03:06,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-23 01:03:06,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 6487a1be79e293e0be794ac021d2fe1a, server=jenkins-hbase4.apache.org,35139,1695430912822 in 202 msec 2023-09-23 01:03:06,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=631dbab607ad15b6810cddd392d3aa0b, UNASSIGN in 211 msec 2023-09-23 01:03:06,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-23 01:03:06,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6487a1be79e293e0be794ac021d2fe1a, UNASSIGN in 209 msec 2023-09-23 01:03:06,119 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-23 01:03:06,121 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985204.631dbab607ad15b6810cddd392d3aa0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:06,121 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695430985204.6487a1be79e293e0be794ac021d2fe1a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:06,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:06,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 01:03:06,171 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, ASSIGN}] 2023-09-23 01:03:06,172 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, ASSIGN 2023-09-23 01:03:06,172 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:03:06,323 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-23 01:03:06,324 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=23ba59de44e0466382f6c3c4d2162ecd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:06,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695430986324"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430986324"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430986324"}]},"ts":"1695430986324"} 2023-09-23 01:03:06,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 23ba59de44e0466382f6c3c4d2162ecd, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:06,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 01:03:06,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:06,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 23ba59de44e0466382f6c3c4d2162ecd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.', STARTKEY => '', ENDKEY => ''} 2023-09-23 01:03:06,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. service=AccessControlService 2023-09-23 01:03:06,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:06,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:06,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/.regioninfo 2023-09-23 01:03:06,492 INFO [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,492 DEBUG [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf 2023-09-23 01:03:06,493 DEBUG [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf 2023-09-23 01:03:06,493 INFO [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 23ba59de44e0466382f6c3c4d2162ecd columnFamilyName cf 2023-09-23 01:03:06,519 DEBUG [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/1d47f4397a0d408da48fb7e2d62a1062.6487a1be79e293e0be794ac021d2fe1a->hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf/1d47f4397a0d408da48fb7e2d62a1062-top 2023-09-23 01:03:06,524 DEBUG [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] regionserver.HStore(539): loaded hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/7169322d14184712bec948767c859601.631dbab607ad15b6810cddd392d3aa0b->hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf/7169322d14184712bec948767c859601-top 2023-09-23 01:03:06,525 INFO [StoreOpener-23ba59de44e0466382f6c3c4d2162ecd-1] regionserver.HStore(310): Store=23ba59de44e0466382f6c3c4d2162ecd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:06,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:06,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 23ba59de44e0466382f6c3c4d2162ecd; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68021926, jitterRate=0.013605684041976929}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:06,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 23ba59de44e0466382f6c3c4d2162ecd: 2023-09-23 01:03:06,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd., pid=77, masterSystemTime=1695430986478 2023-09-23 01:03:06,530 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.,because compaction is disabled. 2023-09-23 01:03:06,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:06,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:06,532 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=23ba59de44e0466382f6c3c4d2162ecd, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:06,532 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695430986532"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695430986532"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695430986532"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695430986532"}]},"ts":"1695430986532"} 2023-09-23 01:03:06,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-23 01:03:06,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 23ba59de44e0466382f6c3c4d2162ecd, server=jenkins-hbase4.apache.org,40973,1695430912916 in 208 msec 2023-09-23 01:03:06,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-23 01:03:06,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, ASSIGN in 364 msec 2023-09-23 01:03:06,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[631dbab607ad15b6810cddd392d3aa0b, 6487a1be79e293e0be794ac021d2fe1a], force=true in 700 msec 2023-09-23 01:03:06,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-23 01:03:06,951 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-23 01:03:06,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 01:03:06,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695430986952 (current time:1695430986952). 2023-09-23 01:03:06,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:06,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x65869ede to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:06,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e8e1bcf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:06,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:06,962 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:06,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65869ede to 127.0.0.1:64606 2023-09-23 01:03:06,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:06,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x31e2a218 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:06,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60c3aa94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:06,970 DEBUG [hconnection-0x1e6d8520-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:06,973 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:06,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:06,978 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:06,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31e2a218 to 127.0.0.1:64606 2023-09-23 01:03:06,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:06,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-23 01:03:06,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:06,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 01:03:06,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 01:03:06,983 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 01:03:06,983 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695431586983 2023-09-23 01:03:06,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-23 01:03:06,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:06,986 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:06,987 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:06,987 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-23 01:03:06,988 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 01:03:06,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-23 01:03:06,989 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 01:03:06,990 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695431586990 2023-09-23 01:03:06,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:06,998 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-23 01:03:06,998 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:06,999 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-23 01:03:06,999 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-23 01:03:07,000 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,000 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,002 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:07,002 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:07,002 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:07,002 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:07,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:07,002 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,002 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:07,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,004 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 01:03:07,004 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-23 01:03:07,004 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 01:03:07,004 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 01:03:07,005 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 01:03:07,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,005 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 01:03:07,005 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,005 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-23 01:03:07,005 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 01:03:07,005 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:07,006 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,006 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 01:03:07,006 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 01:03:07,006 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-23 01:03:07,006 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:07,006 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 01:03:07,007 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-23 01:03:07,007 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-23 01:03:07,007 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-23 01:03:07,008 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:07,009 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:07,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:07,009 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:07,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-23 01:03:07,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34e21ad5[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:07,011 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-23 01:03:07,011 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,012 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,012 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,012 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,013 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 01:03:07,013 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:07,013 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:07,013 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. started... 2023-09-23 01:03:07,015 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 23ba59de44e0466382f6c3c4d2162ecd: 2023-09-23 01:03:07,015 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,015 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:07,015 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/1d47f4397a0d408da48fb7e2d62a1062.6487a1be79e293e0be794ac021d2fe1a->hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf/1d47f4397a0d408da48fb7e2d62a1062-top, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/7169322d14184712bec948767c859601.631dbab607ad15b6810cddd392d3aa0b->hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf/7169322d14184712bec948767c859601-top] hfiles 2023-09-23 01:03:07,015 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/1d47f4397a0d408da48fb7e2d62a1062.6487a1be79e293e0be794ac021d2fe1a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,016 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/7169322d14184712bec948767c859601.631dbab607ad15b6810cddd392d3aa0b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 01:03:07,018 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:07,019 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 01:03:07,020 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 01:03:07,020 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:07,020 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 01:03:07,027 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. completed. 2023-09-23 01:03:07,027 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-23 01:03:07,027 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-23 01:03:07,036 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:07,036 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-23 01:03:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:03:07,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-23 01:03:07,039 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-23 01:03:07,040 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:07,040 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:07,040 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,040 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:07,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:07,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:07,041 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:07,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:07,042 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:07,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,042 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,049 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,051 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:07,051 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,051 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:07,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:07,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:07,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:07,055 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:07,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,054 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,055 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:07,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:07,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:07,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-23 01:03:07,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695430986983Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695430987055 (+72 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695430987055Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695430987058 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695430987069 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695430987077 (+8 ms) 2023-09-23 01:03:07,080 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-23 01:03:07,082 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 94 msec 2023-09-23 01:03:07,087 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:07,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-23 01:03:07,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:07,088 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088 2023-09-23 01:03:07,088 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36407, tgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088, rawTgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:03:07,110 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:03:07,110 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_194872648_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,110 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-23 01:03:07,118 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:07,141 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:07,141 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:07,142 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:07,142 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,017 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-3447628692113650162.jar 2023-09-23 01:03:08,018 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,018 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,084 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-4251253097965856352.jar 2023-09-23 01:03:08,085 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,085 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,086 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,086 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,086 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,087 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:08,087 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:03:08,087 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:03:08,088 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:03:08,088 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:03:08,088 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:03:08,089 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:03:08,089 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:03:08,089 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:03:08,090 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:03:08,090 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:03:08,091 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:08,091 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:08,092 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:08,092 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:08,092 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:08,093 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:08,093 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:08,458 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:03:08,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0004_000001 (auth:SIMPLE) 2023-09-23 01:03:08,461 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-23 01:03:08,465 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-23 01:03:08,523 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:03:08,523 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:03:09,330 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:03:09,406 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0005_000001 (auth:SIMPLE) 2023-09-23 01:03:13,128 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0005_000001 (auth:SIMPLE) 2023-09-23 01:03:15,328 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0005_000001 (auth:SIMPLE) 2023-09-23 01:03:17,666 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0005_000001 (auth:SIMPLE) 2023-09-23 01:03:19,638 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:03:19,641 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:03:19,650 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,650 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:03:19,650 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:03:19,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 01:03:19,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 01:03:19,651 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,652 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-23 01:03:19,652 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695430987088/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-23 01:03:19,659 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 01:03:19,663 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430999663"}]},"ts":"1695430999663"} 2023-09-23 01:03:19,664 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-23 01:03:19,666 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-23 01:03:19,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, UNASSIGN}] 2023-09-23 01:03:19,668 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, UNASSIGN 2023-09-23 01:03:19,669 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=23ba59de44e0466382f6c3c4d2162ecd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:19,669 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695430999669"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695430999669"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695430999669"}]},"ts":"1695430999669"} 2023-09-23 01:03:19,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 23ba59de44e0466382f6c3c4d2162ecd, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:19,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 01:03:19,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:19,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 23ba59de44e0466382f6c3c4d2162ecd, disabling compactions & flushes 2023-09-23 01:03:19,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:19,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:19,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. after waiting 0 ms 2023-09-23 01:03:19,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:19,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-23 01:03:19,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:19,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd. 2023-09-23 01:03:19,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 23ba59de44e0466382f6c3c4d2162ecd: 2023-09-23 01:03:19,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:19,836 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=23ba59de44e0466382f6c3c4d2162ecd, regionState=CLOSED 2023-09-23 01:03:19,836 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695430999836"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695430999836"}]},"ts":"1695430999836"} 2023-09-23 01:03:19,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-23 01:03:19,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 23ba59de44e0466382f6c3c4d2162ecd, server=jenkins-hbase4.apache.org,40973,1695430912916 in 167 msec 2023-09-23 01:03:19,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-23 01:03:19,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=23ba59de44e0466382f6c3c4d2162ecd, UNASSIGN in 172 msec 2023-09-23 01:03:19,840 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695430999840"}]},"ts":"1695430999840"} 2023-09-23 01:03:19,841 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-23 01:03:19,843 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-23 01:03:19,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 185 msec 2023-09-23 01:03:19,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-23 01:03:19,965 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-23 01:03:19,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,969 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,970 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,972 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,974 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:19,974 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:19,974 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:19,975 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,975 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,975 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,975 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 01:03:19,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 01:03:19,975 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 01:03:19,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,977 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:19,977 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/recovered.edits] 2023-09-23 01:03:19,977 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/recovered.edits] 2023-09-23 01:03:19,977 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/recovered.edits] 2023-09-23 01:03:19,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 01:03:19,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:19,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:19,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:19,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:19,982 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf/1d47f4397a0d408da48fb7e2d62a1062 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/cf/1d47f4397a0d408da48fb7e2d62a1062 2023-09-23 01:03:19,982 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf/7169322d14184712bec948767c859601 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/cf/7169322d14184712bec948767c859601 2023-09-23 01:03:19,982 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/1d47f4397a0d408da48fb7e2d62a1062.6487a1be79e293e0be794ac021d2fe1a to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/1d47f4397a0d408da48fb7e2d62a1062.6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:19,984 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/7169322d14184712bec948767c859601.631dbab607ad15b6810cddd392d3aa0b to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/cf/7169322d14184712bec948767c859601.631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:19,986 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/recovered.edits/8.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a/recovered.edits/8.seqid 2023-09-23 01:03:19,986 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/recovered.edits/8.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b/recovered.edits/8.seqid 2023-09-23 01:03:19,987 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6487a1be79e293e0be794ac021d2fe1a 2023-09-23 01:03:19,987 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/631dbab607ad15b6810cddd392d3aa0b 2023-09-23 01:03:19,988 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/recovered.edits/12.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd/recovered.edits/12.seqid 2023-09-23 01:03:19,988 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/23ba59de44e0466382f6c3c4d2162ecd 2023-09-23 01:03:19,988 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-23 01:03:19,990 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,993 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-23 01:03:19,995 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-23 01:03:19,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:19,996 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-23 01:03:19,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695430999996"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:20,001 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-23 01:03:20,001 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 23ba59de44e0466382f6c3c4d2162ecd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695430985205.23ba59de44e0466382f6c3c4d2162ecd.', STARTKEY => '', ENDKEY => ''}] 2023-09-23 01:03:20,001 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-23 01:03:20,001 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695431000001"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:20,003 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-23 01:03:20,004 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:20,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 39 msec 2023-09-23 01:03:20,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-23 01:03:20,080 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-23 01:03:20,080 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 01:03:20,085 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431000085"}]},"ts":"1695431000085"} 2023-09-23 01:03:20,087 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-23 01:03:20,088 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-23 01:03:20,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, UNASSIGN}] 2023-09-23 01:03:20,091 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, UNASSIGN 2023-09-23 01:03:20,091 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, UNASSIGN 2023-09-23 01:03:20,091 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=19f0c4d7d11d7eeedaa767abc933de04, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:20,092 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c63c21656440f0f581aa8904a5213c63, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:20,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695431000091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431000091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431000091"}]},"ts":"1695431000091"} 2023-09-23 01:03:20,092 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695431000091"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431000091"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431000091"}]},"ts":"1695431000091"} 2023-09-23 01:03:20,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 19f0c4d7d11d7eeedaa767abc933de04, server=jenkins-hbase4.apache.org,34471,1695430912871}] 2023-09-23 01:03:20,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure c63c21656440f0f581aa8904a5213c63, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:20,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 01:03:20,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:20,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 19f0c4d7d11d7eeedaa767abc933de04, disabling compactions & flushes 2023-09-23 01:03:20,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:20,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:20,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. after waiting 0 ms 2023-09-23 01:03:20,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:20,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:20,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c63c21656440f0f581aa8904a5213c63, disabling compactions & flushes 2023-09-23 01:03:20,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:20,248 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:20,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. after waiting 0 ms 2023-09-23 01:03:20,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:20,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:20,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:20,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:20,258 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:20,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63. 2023-09-23 01:03:20,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c63c21656440f0f581aa8904a5213c63: 2023-09-23 01:03:20,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04. 2023-09-23 01:03:20,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 19f0c4d7d11d7eeedaa767abc933de04: 2023-09-23 01:03:20,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:20,261 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=c63c21656440f0f581aa8904a5213c63, regionState=CLOSED 2023-09-23 01:03:20,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:20,262 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695431000261"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431000261"}]},"ts":"1695431000261"} 2023-09-23 01:03:20,262 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=19f0c4d7d11d7eeedaa767abc933de04, regionState=CLOSED 2023-09-23 01:03:20,262 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695431000262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431000262"}]},"ts":"1695431000262"} 2023-09-23 01:03:20,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-23 01:03:20,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure c63c21656440f0f581aa8904a5213c63, server=jenkins-hbase4.apache.org,40973,1695430912916 in 169 msec 2023-09-23 01:03:20,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-23 01:03:20,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 19f0c4d7d11d7eeedaa767abc933de04, server=jenkins-hbase4.apache.org,34471,1695430912871 in 171 msec 2023-09-23 01:03:20,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c63c21656440f0f581aa8904a5213c63, UNASSIGN in 176 msec 2023-09-23 01:03:20,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-23 01:03:20,266 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=19f0c4d7d11d7eeedaa767abc933de04, UNASSIGN in 176 msec 2023-09-23 01:03:20,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431000267"}]},"ts":"1695431000267"} 2023-09-23 01:03:20,268 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-23 01:03:20,271 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-23 01:03:20,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-09-23 01:03:20,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-23 01:03:20,387 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-23 01:03:20,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,391 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,393 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,395 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,395 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,395 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,395 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 01:03:20,396 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:20,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 01:03:20,396 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:20,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 01:03:20,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,397 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,398 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/recovered.edits] 2023-09-23 01:03:20,398 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/recovered.edits] 2023-09-23 01:03:20,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 01:03:20,402 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf/4f089e833ca44612ad2a5f28cd5989b7 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/cf/4f089e833ca44612ad2a5f28cd5989b7 2023-09-23 01:03:20,402 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf/91afc4e0244447018b97206255112ddb to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/cf/91afc4e0244447018b97206255112ddb 2023-09-23 01:03:20,405 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63/recovered.edits/9.seqid 2023-09-23 01:03:20,405 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04/recovered.edits/9.seqid 2023-09-23 01:03:20,406 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c63c21656440f0f581aa8904a5213c63 2023-09-23 01:03:20,406 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/19f0c4d7d11d7eeedaa767abc933de04 2023-09-23 01:03:20,406 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-23 01:03:20,407 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 01:03:20,407 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-23 01:03:20,410 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923651088231d9f464390ff01f8df56cf29 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230923651088231d9f464390ff01f8df56cf29 2023-09-23 01:03:20,411 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923b79146d4d904403887dd501f485cfce3 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230923b79146d4d904403887dd501f485cfce3 2023-09-23 01:03:20,412 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-23 01:03:20,414 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,416 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-23 01:03:20,418 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-23 01:03:20,419 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,419 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-23 01:03:20,419 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695431000419"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:20,419 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695431000419"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:20,420 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 01:03:20,420 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 19f0c4d7d11d7eeedaa767abc933de04, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695430984046.19f0c4d7d11d7eeedaa767abc933de04.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c63c21656440f0f581aa8904a5213c63, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695430984046.c63c21656440f0f581aa8904a5213c63.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 01:03:20,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-23 01:03:20,421 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695431000420"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:20,422 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-23 01:03:20,425 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,426 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-23 01:03:20,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-23 01:03:20,499 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-23 01:03:20,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 01:03:20,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-23 01:03:20,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-23 01:03:20,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-23 01:03:20,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-23 01:03:20,538 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 746) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536207051_1 at /127.0.0.1:48996 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-536207051_1 at /127.0.0.1:59962 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:49018 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:59986 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:44957 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:41906 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4070 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=184 (was 217), ProcessCount=169 (was 169), AvailableMemoryMB=1074 (was 1123) 2023-09-23 01:03:20,539 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-23 01:03:20,558 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=184, ProcessCount=169, AvailableMemoryMB=1073 2023-09-23 01:03:20,558 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-23 01:03:20,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 01:03:20,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:20,563 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:03:20,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-23 01:03:20,564 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:03:20,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 01:03:20,566 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,566 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,566 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c empty. 2023-09-23 01:03:20,566 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 empty. 2023-09-23 01:03:20,567 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,567 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,567 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 01:03:20,576 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-23 01:03:20,577 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cac229575afb4e2eb24d1d743a921e2c, NAME => 'testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:20,577 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0602f2e8e9271d82936084ef0cf6c1d3, NAME => 'testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:20,584 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:20,584 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0602f2e8e9271d82936084ef0cf6c1d3, disabling compactions & flushes 2023-09-23 01:03:20,584 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:20,585 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cac229575afb4e2eb24d1d743a921e2c, disabling compactions & flushes 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,585 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. after waiting 0 ms 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. after waiting 0 ms 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,585 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,585 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0602f2e8e9271d82936084ef0cf6c1d3: 2023-09-23 01:03:20,585 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cac229575afb4e2eb24d1d743a921e2c: 2023-09-23 01:03:20,587 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:03:20,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431000588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431000588"}]},"ts":"1695431000588"} 2023-09-23 01:03:20,588 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431000588"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431000588"}]},"ts":"1695431000588"} 2023-09-23 01:03:20,590 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:03:20,591 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:03:20,591 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431000591"}]},"ts":"1695431000591"} 2023-09-23 01:03:20,592 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-23 01:03:20,595 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:03:20,596 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:03:20,596 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:03:20,596 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:03:20,596 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:03:20,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, ASSIGN}] 2023-09-23 01:03:20,598 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, ASSIGN 2023-09-23 01:03:20,599 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, ASSIGN 2023-09-23 01:03:20,599 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34471,1695430912871; forceNewPlan=false, retain=false 2023-09-23 01:03:20,599 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:03:20,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 01:03:20,749 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:03:20,752 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cac229575afb4e2eb24d1d743a921e2c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:20,752 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0602f2e8e9271d82936084ef0cf6c1d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:20,752 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431000752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431000752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431000752"}]},"ts":"1695431000752"} 2023-09-23 01:03:20,752 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431000752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431000752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431000752"}]},"ts":"1695431000752"} 2023-09-23 01:03:20,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure cac229575afb4e2eb24d1d743a921e2c, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:20,755 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 0602f2e8e9271d82936084ef0cf6c1d3, server=jenkins-hbase4.apache.org,34471,1695430912871}] 2023-09-23 01:03:20,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 01:03:20,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cac229575afb4e2eb24d1d743a921e2c, NAME => 'testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0602f2e8e9271d82936084ef0cf6c1d3, NAME => 'testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. service=AccessControlService 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. service=AccessControlService 2023-09-23 01:03:20,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:20,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:20,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:20,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,914 INFO [StoreOpener-0602f2e8e9271d82936084ef0cf6c1d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,914 INFO [StoreOpener-cac229575afb4e2eb24d1d743a921e2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,915 DEBUG [StoreOpener-0602f2e8e9271d82936084ef0cf6c1d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf 2023-09-23 01:03:20,915 DEBUG [StoreOpener-0602f2e8e9271d82936084ef0cf6c1d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf 2023-09-23 01:03:20,915 DEBUG [StoreOpener-cac229575afb4e2eb24d1d743a921e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf 2023-09-23 01:03:20,915 DEBUG [StoreOpener-cac229575afb4e2eb24d1d743a921e2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf 2023-09-23 01:03:20,915 INFO [StoreOpener-cac229575afb4e2eb24d1d743a921e2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cac229575afb4e2eb24d1d743a921e2c columnFamilyName cf 2023-09-23 01:03:20,915 INFO [StoreOpener-0602f2e8e9271d82936084ef0cf6c1d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0602f2e8e9271d82936084ef0cf6c1d3 columnFamilyName cf 2023-09-23 01:03:20,917 INFO [StoreOpener-cac229575afb4e2eb24d1d743a921e2c-1] regionserver.HStore(310): Store=cac229575afb4e2eb24d1d743a921e2c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:20,917 INFO [StoreOpener-0602f2e8e9271d82936084ef0cf6c1d3-1] regionserver.HStore(310): Store=0602f2e8e9271d82936084ef0cf6c1d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:20,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:20,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:20,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:20,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:20,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cac229575afb4e2eb24d1d743a921e2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69890743, jitterRate=0.041453227400779724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:20,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0602f2e8e9271d82936084ef0cf6c1d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66531613, jitterRate=-0.008601710200309753}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:20,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cac229575afb4e2eb24d1d743a921e2c: 2023-09-23 01:03:20,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0602f2e8e9271d82936084ef0cf6c1d3: 2023-09-23 01:03:20,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c., pid=93, masterSystemTime=1695431000905 2023-09-23 01:03:20,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3., pid=94, masterSystemTime=1695431000906 2023-09-23 01:03:20,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:20,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:20,926 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=0602f2e8e9271d82936084ef0cf6c1d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:20,926 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431000926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695431000926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695431000926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695431000926"}]},"ts":"1695431000926"} 2023-09-23 01:03:20,926 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=cac229575afb4e2eb24d1d743a921e2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:20,926 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431000926"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695431000926"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695431000926"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695431000926"}]},"ts":"1695431000926"} 2023-09-23 01:03:20,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-23 01:03:20,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 0602f2e8e9271d82936084ef0cf6c1d3, server=jenkins-hbase4.apache.org,34471,1695430912871 in 173 msec 2023-09-23 01:03:20,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-23 01:03:20,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure cac229575afb4e2eb24d1d743a921e2c, server=jenkins-hbase4.apache.org,35139,1695430912822 in 174 msec 2023-09-23 01:03:20,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, ASSIGN in 333 msec 2023-09-23 01:03:20,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-23 01:03:20,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, ASSIGN in 334 msec 2023-09-23 01:03:20,932 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:03:20,932 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431000932"}]},"ts":"1695431000932"} 2023-09-23 01:03:20,933 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-23 01:03:20,935 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:03:20,935 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-23 01:03:20,937 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 01:03:20,939 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,939 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,939 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,939 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:20,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:20,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:20,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:20,940 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:20,941 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 380 msec 2023-09-23 01:03:21,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-23 01:03:21,168 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-23 01:03:21,170 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:21,170 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:21,172 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:03:21,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:03:21,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695431001182 (current time:1695431001182). 2023-09-23 01:03:21,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:21,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x6623ba7d to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:21,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5640aa6d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:21,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:21,195 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6623ba7d to 127.0.0.1:64606 2023-09-23 01:03:21,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:21,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3804bf7f to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:21,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@438f1a50, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:21,203 DEBUG [hconnection-0x104fc38e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:21,205 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:21,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:21,211 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:21,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3804bf7f to 127.0.0.1:64606 2023-09-23 01:03:21,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:21,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 01:03:21,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:21,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:03:21,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:03:21,216 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:03:21,216 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695431601216 2023-09-23 01:03:21,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:21,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:03:21,217 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:21,218 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:21,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 01:03:21,218 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:03:21,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-23 01:03:21,222 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 01:03:21,223 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695431601223 2023-09-23 01:03:21,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,231 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-23 01:03:21,231 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,232 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 01:03:21,232 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 01:03:21,232 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,232 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,238 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,238 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,238 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,238 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,239 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,239 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,239 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,239 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 01:03:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 01:03:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 01:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 01:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,242 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 01:03:21,243 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 01:03:21,243 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 01:03:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,243 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 01:03:21,244 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 01:03:21,244 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 01:03:21,244 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 01:03:21,243 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 01:03:21,246 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,247 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,247 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,247 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:21,247 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,247 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:21,251 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,252 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,253 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,253 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bd97ee8[Count = 1] remaining members to acquire global barrier 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 01:03:21,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bd97ee8[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:21,256 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 01:03:21,256 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:03:21,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,258 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,258 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:21,258 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:21,258 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:21,258 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. started... 2023-09-23 01:03:21,258 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:21,258 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:03:21,258 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:03:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 01:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cac229575afb4e2eb24d1d743a921e2c: 2023-09-23 01:03:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:21,259 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. started... 2023-09-23 01:03:21,259 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:03:21,260 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0602f2e8e9271d82936084ef0cf6c1d3: 2023-09-23 01:03:21,260 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,260 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:21,260 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:03:21,262 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 01:03:21,262 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,262 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 01:03:21,278 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. completed. 2023-09-23 01:03:21,278 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. completed. 2023-09-23 01:03:21,278 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:21,278 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:21,278 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:21,280 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,280 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 01:03:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,280 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,280 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 01:03:21,281 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,282 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 01:03:21,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,282 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,282 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 01:03:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34471,1695430912871': 2023-09-23 01:03:21,288 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 01:03:21,288 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 01:03:21,289 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:21,289 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:21,289 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,289 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,290 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,291 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,292 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,292 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,294 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,294 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,294 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,298 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,298 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,298 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,299 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:21,299 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,300 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,300 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,300 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:03:21,300 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,301 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,301 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,301 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 01:03:21,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,318 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:21,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:03:21,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:03:21,319 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:03:21,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 01:03:21,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,327 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695431001216Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695431001309 (+93 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695431001309Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695431001309Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695431001313 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695431001320 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695431001326 (+6 ms) 2023-09-23 01:03:21,330 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 01:03:21,331 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 113 msec 2023-09-23 01:03:21,519 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:21,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:03:21,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:21,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35139] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:03:21,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34471] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:03:21,526 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:21,526 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:21,527 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:03:21,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:03:21,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695431001536 (current time:1695431001536). 2023-09-23 01:03:21,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:21,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x1d4b4dd2 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:21,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73f6ae46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:21,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:21,547 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:21,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d4b4dd2 to 127.0.0.1:64606 2023-09-23 01:03:21,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:21,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x7be609f0 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:21,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c84ee83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:21,554 DEBUG [hconnection-0x7a46e3cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:21,555 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:21,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:21,559 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59894, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7be609f0 to 127.0.0.1:64606 2023-09-23 01:03:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-23 01:03:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:21,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:03:21,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:03:21,563 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:03:21,564 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695431601564 2023-09-23 01:03:21,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-23 01:03:21,564 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:21,565 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:21,565 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:21,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 01:03:21,566 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-23 01:03:21,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-23 01:03:21,568 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 01:03:21,568 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695431601568 2023-09-23 01:03:21,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,576 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-23 01:03:21,576 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,577 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-23 01:03:21,577 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-23 01:03:21,577 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,577 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,579 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,579 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,579 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,579 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,580 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,580 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,580 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,580 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 01:03:21,581 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 01:03:21,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 01:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 01:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-23 01:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 01:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 01:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:21,582 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 01:03:21,586 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-23 01:03:21,586 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-23 01:03:21,583 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 01:03:21,586 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-23 01:03:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,588 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,588 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,589 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,589 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f87357f[Count = 1] remaining members to acquire global barrier 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-23 01:03:21,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f87357f[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:21,592 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-23 01:03:21,592 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:03:21,602 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:03:21,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,602 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-23 01:03:21,602 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:21,602 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 01:03:21,603 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:21,602 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:21,603 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. started... 2023-09-23 01:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:21,603 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:21,603 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:21,603 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cac229575afb4e2eb24d1d743a921e2c 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-23 01:03:21,603 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:21,603 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. started... 2023-09-23 01:03:21,603 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0602f2e8e9271d82936084ef0cf6c1d3 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-23 01:03:21,604 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 01:03:21,604 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,604 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 01:03:21,621 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309231854d320ae24414d9ffc60e302adb9b6 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309231854d320ae24414d9ffc60e302adb9b6 2023-09-23 01:03:21,621 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092398604bb4bf944f48ac0ef037d9d1f2f0 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092398604bb4bf944f48ac0ef037d9d1f2f0 2023-09-23 01:03:21,628 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/.tmp/cf/2caf12ee9fad4700a8ea98f540065b9e 2023-09-23 01:03:21,628 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/.tmp/cf/7728e74265c640939d31d1350d949019 2023-09-23 01:03:21,633 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/.tmp/cf/7728e74265c640939d31d1350d949019 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf/7728e74265c640939d31d1350d949019 2023-09-23 01:03:21,633 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/.tmp/cf/2caf12ee9fad4700a8ea98f540065b9e as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf/2caf12ee9fad4700a8ea98f540065b9e 2023-09-23 01:03:21,638 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf/7728e74265c640939d31d1350d949019, entries=45, sequenceid=6, filesize=12.7 K 2023-09-23 01:03:21,638 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf/2caf12ee9fad4700a8ea98f540065b9e, entries=5, sequenceid=6, filesize=5.8 K 2023-09-23 01:03:21,639 INFO [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 0602f2e8e9271d82936084ef0cf6c1d3 in 36ms, sequenceid=6, compaction requested=false 2023-09-23 01:03:21,639 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-23 01:03:21,640 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0602f2e8e9271d82936084ef0cf6c1d3: 2023-09-23 01:03:21,640 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,641 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:21,641 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf/7728e74265c640939d31d1350d949019] hfiles 2023-09-23 01:03:21,641 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf/7728e74265c640939d31d1350d949019 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,641 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for cac229575afb4e2eb24d1d743a921e2c in 38ms, sequenceid=6, compaction requested=false 2023-09-23 01:03:21,643 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cac229575afb4e2eb24d1d743a921e2c: 2023-09-23 01:03:21,643 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,643 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:21,643 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf/2caf12ee9fad4700a8ea98f540065b9e] hfiles 2023-09-23 01:03:21,643 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf/2caf12ee9fad4700a8ea98f540065b9e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,657 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. completed. 2023-09-23 01:03:21,657 DEBUG [rs(jenkins-hbase4.apache.org,34471,1695430912871)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 01:03:21,657 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:21,659 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. completed. 2023-09-23 01:03:21,659 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,659 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-23 01:03:21,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,659 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:21,660 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 01:03:21,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,662 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,662 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-23 01:03:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,663 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-23 01:03:21,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,665 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:21,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:03:21,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:03:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,667 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:03:21,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34471,1695430912871': 2023-09-23 01:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-23 01:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:03:21,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-23 01:03:21,672 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-23 01:03:21,672 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:21,672 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:21,672 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,672 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:21,675 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,675 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:21,675 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,675 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,675 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:21,676 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,676 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,676 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,676 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:21,677 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:21,679 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,679 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,679 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,682 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,682 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,684 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:21,684 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:21,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:21,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:21,684 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:21,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:03:21,685 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,685 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:21,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:21,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092398604bb4bf944f48ac0ef037d9d1f2f0, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309231854d320ae24414d9ffc60e302adb9b6] mob files 2023-09-23 01:03:21,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092398604bb4bf944f48ac0ef037d9d1f2f0 2023-09-23 01:03:21,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309231854d320ae24414d9ffc60e302adb9b6 2023-09-23 01:03:21,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,710 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-23 01:03:21,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,710 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695431001564Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695431001693 (+129 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695431001693Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695431001693Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695431001696 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695431001703 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695431001710 (+7 ms) 2023-09-23 01:03:21,716 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-23 01:03:21,717 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 151 msec 2023-09-23 01:03:21,867 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:21,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-23 01:03:21,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:21,868 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868 2023-09-23 01:03:21,869 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36407, tgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868, rawTgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:03:21,890 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:03:21,890 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-947906115_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,890 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-23 01:03:21,896 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:21,915 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:21,915 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:21,916 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:21,916 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,785 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-7156769996011188444.jar 2023-09-23 01:03:22,785 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,786 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,852 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-5785963095788702503.jar 2023-09-23 01:03:22,852 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,853 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,853 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,853 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,854 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,854 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:22,854 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:03:22,855 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:03:22,855 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:03:22,855 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:03:22,856 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:03:22,856 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:03:22,856 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:03:22,857 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:03:22,857 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:03:22,858 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:03:22,858 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:22,858 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:22,859 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:22,859 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:22,859 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:22,860 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:22,860 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:23,220 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:03:23,222 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-23 01:03:23,843 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:03:23,843 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:03:23,847 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0005_000001 (auth:SIMPLE) 2023-09-23 01:03:24,468 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0006_000001 (auth:SIMPLE) 2023-09-23 01:03:25,425 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:03:28,114 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0006_000001 (auth:SIMPLE) 2023-09-23 01:03:30,560 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:03:30,561 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:03:30,566 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:30,566 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:03:30,567 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:03:30,567 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:30,567 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 01:03:30,567 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 01:03:30,567 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:30,568 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-23 01:03:30,568 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431001868/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-23 01:03:30,572 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 01:03:30,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431010576"}]},"ts":"1695431010576"} 2023-09-23 01:03:30,577 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-23 01:03:30,579 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-23 01:03:30,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, UNASSIGN}] 2023-09-23 01:03:30,582 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, UNASSIGN 2023-09-23 01:03:30,582 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, UNASSIGN 2023-09-23 01:03:30,582 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cac229575afb4e2eb24d1d743a921e2c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:30,582 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0602f2e8e9271d82936084ef0cf6c1d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:30,582 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431010582"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431010582"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431010582"}]},"ts":"1695431010582"} 2023-09-23 01:03:30,582 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431010582"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431010582"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431010582"}]},"ts":"1695431010582"} 2023-09-23 01:03:30,584 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure cac229575afb4e2eb24d1d743a921e2c, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:30,584 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 0602f2e8e9271d82936084ef0cf6c1d3, server=jenkins-hbase4.apache.org,34471,1695430912871}] 2023-09-23 01:03:30,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 01:03:30,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:30,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:30,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cac229575afb4e2eb24d1d743a921e2c, disabling compactions & flushes 2023-09-23 01:03:30,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0602f2e8e9271d82936084ef0cf6c1d3, disabling compactions & flushes 2023-09-23 01:03:30,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:30,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:30,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:30,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:30,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. after waiting 0 ms 2023-09-23 01:03:30,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:30,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. after waiting 0 ms 2023-09-23 01:03:30,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:30,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:30,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:30,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:30,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:30,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3. 2023-09-23 01:03:30,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0602f2e8e9271d82936084ef0cf6c1d3: 2023-09-23 01:03:30,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c. 2023-09-23 01:03:30,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cac229575afb4e2eb24d1d743a921e2c: 2023-09-23 01:03:30,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:30,748 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=0602f2e8e9271d82936084ef0cf6c1d3, regionState=CLOSED 2023-09-23 01:03:30,749 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431010748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431010748"}]},"ts":"1695431010748"} 2023-09-23 01:03:30,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:30,749 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=cac229575afb4e2eb24d1d743a921e2c, regionState=CLOSED 2023-09-23 01:03:30,749 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695431010749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431010749"}]},"ts":"1695431010749"} 2023-09-23 01:03:30,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-23 01:03:30,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 0602f2e8e9271d82936084ef0cf6c1d3, server=jenkins-hbase4.apache.org,34471,1695430912871 in 166 msec 2023-09-23 01:03:30,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-23 01:03:30,754 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure cac229575afb4e2eb24d1d743a921e2c, server=jenkins-hbase4.apache.org,35139,1695430912822 in 169 msec 2023-09-23 01:03:30,754 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=0602f2e8e9271d82936084ef0cf6c1d3, UNASSIGN in 173 msec 2023-09-23 01:03:30,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-23 01:03:30,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=cac229575afb4e2eb24d1d743a921e2c, UNASSIGN in 174 msec 2023-09-23 01:03:30,756 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431010756"}]},"ts":"1695431010756"} 2023-09-23 01:03:30,757 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-23 01:03:30,758 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-23 01:03:30,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 187 msec 2023-09-23 01:03:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-23 01:03:30,878 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-23 01:03:30,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,882 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,883 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,884 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,887 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:30,887 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:30,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,887 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 01:03:30,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 01:03:30,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 01:03:30,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:30,889 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/recovered.edits] 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,889 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:30,889 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/recovered.edits] 2023-09-23 01:03:30,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 01:03:30,894 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf/2caf12ee9fad4700a8ea98f540065b9e to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/cf/2caf12ee9fad4700a8ea98f540065b9e 2023-09-23 01:03:30,894 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf/7728e74265c640939d31d1350d949019 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/cf/7728e74265c640939d31d1350d949019 2023-09-23 01:03:30,897 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c/recovered.edits/9.seqid 2023-09-23 01:03:30,897 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3/recovered.edits/9.seqid 2023-09-23 01:03:30,897 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/cac229575afb4e2eb24d1d743a921e2c 2023-09-23 01:03:30,897 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testEmptyExportFileSystemState/0602f2e8e9271d82936084ef0cf6c1d3 2023-09-23 01:03:30,897 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-23 01:03:30,898 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 01:03:30,898 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-23 01:03:30,901 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092398604bb4bf944f48ac0ef037d9d1f2f0 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023092398604bb4bf944f48ac0ef037d9d1f2f0 2023-09-23 01:03:30,903 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309231854d320ae24414d9ffc60e302adb9b6 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309231854d320ae24414d9ffc60e302adb9b6 2023-09-23 01:03:30,903 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-23 01:03:30,905 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,907 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-23 01:03:30,909 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-23 01:03:30,910 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,910 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-23 01:03:30,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695431010910"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:30,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695431010910"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:30,913 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 01:03:30,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cac229575afb4e2eb24d1d743a921e2c, NAME => 'testtb-testEmptyExportFileSystemState,,1695431000560.cac229575afb4e2eb24d1d743a921e2c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0602f2e8e9271d82936084ef0cf6c1d3, NAME => 'testtb-testEmptyExportFileSystemState,1,1695431000560.0602f2e8e9271d82936084ef0cf6c1d3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 01:03:30,913 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-23 01:03:30,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695431010913"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:30,916 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-23 01:03:30,918 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-23 01:03:30,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-23 01:03:30,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-23 01:03:30,991 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-23 01:03:30,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-23 01:03:31,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:31,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-23 01:03:31,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-23 01:03:31,030 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:45280 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:38882 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:36419 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4722 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:42777 from appattempt_1695430919334_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:38120 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_18739098_1 at /127.0.0.1:38872 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:41265 from appattempt_1695430919334_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=947 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 184), ProcessCount=168 (was 169), AvailableMemoryMB=1076 (was 1073) - AvailableMemoryMB LEAK? - 2023-09-23 01:03:31,030 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 01:03:31,051 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=947, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=168, AvailableMemoryMB=1075 2023-09-23 01:03:31,051 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-23 01:03:31,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-23 01:03:31,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,056 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-23 01:03:31,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-23 01:03:31,057 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-23 01:03:31,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 01:03:31,059 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,059 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,059 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada empty. 2023-09-23 01:03:31,059 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 empty. 2023-09-23 01:03:31,060 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,060 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,060 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 01:03:31,069 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-23 01:03:31,070 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb405ee2158d58f3a92735da4f90fada, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:31,071 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f16e365fc2b4f8b47779b05bca52e32, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6f16e365fc2b4f8b47779b05bca52e32, disabling compactions & flushes 2023-09-23 01:03:31,078 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing bb405ee2158d58f3a92735da4f90fada, disabling compactions & flushes 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. after waiting 0 ms 2023-09-23 01:03:31,078 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,078 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. after waiting 0 ms 2023-09-23 01:03:31,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6f16e365fc2b4f8b47779b05bca52e32: 2023-09-23 01:03:31,079 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for bb405ee2158d58f3a92735da4f90fada: 2023-09-23 01:03:31,080 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-23 01:03:31,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431011081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431011081"}]},"ts":"1695431011081"} 2023-09-23 01:03:31,081 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431011081"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431011081"}]},"ts":"1695431011081"} 2023-09-23 01:03:31,083 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-23 01:03:31,084 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-23 01:03:31,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431011084"}]},"ts":"1695431011084"} 2023-09-23 01:03:31,085 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-23 01:03:31,089 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-23 01:03:31,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-23 01:03:31,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-23 01:03:31,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-23 01:03:31,090 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-23 01:03:31,091 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, ASSIGN}] 2023-09-23 01:03:31,094 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, ASSIGN 2023-09-23 01:03:31,094 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, ASSIGN 2023-09-23 01:03:31,094 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40973,1695430912916; forceNewPlan=false, retain=false 2023-09-23 01:03:31,094 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35139,1695430912822; forceNewPlan=false, retain=false 2023-09-23 01:03:31,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 01:03:31,244 INFO [jenkins-hbase4:42795] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-23 01:03:31,247 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6f16e365fc2b4f8b47779b05bca52e32, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,247 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bb405ee2158d58f3a92735da4f90fada, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,247 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431011247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431011247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431011247"}]},"ts":"1695431011247"} 2023-09-23 01:03:31,247 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431011247"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431011247"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431011247"}]},"ts":"1695431011247"} 2023-09-23 01:03:31,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure bb405ee2158d58f3a92735da4f90fada, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:31,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 6f16e365fc2b4f8b47779b05bca52e32, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:31,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 01:03:31,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb405ee2158d58f3a92735da4f90fada, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.', STARTKEY => '', ENDKEY => '1'} 2023-09-23 01:03:31,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. service=AccessControlService 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f16e365fc2b4f8b47779b05bca52e32, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.', STARTKEY => '1', ENDKEY => ''} 2023-09-23 01:03:31,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. service=AccessControlService 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:31,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,406 INFO [StoreOpener-6f16e365fc2b4f8b47779b05bca52e32-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,406 INFO [StoreOpener-bb405ee2158d58f3a92735da4f90fada-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,407 DEBUG [StoreOpener-6f16e365fc2b4f8b47779b05bca52e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf 2023-09-23 01:03:31,407 DEBUG [StoreOpener-6f16e365fc2b4f8b47779b05bca52e32-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf 2023-09-23 01:03:31,407 DEBUG [StoreOpener-bb405ee2158d58f3a92735da4f90fada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf 2023-09-23 01:03:31,407 DEBUG [StoreOpener-bb405ee2158d58f3a92735da4f90fada-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf 2023-09-23 01:03:31,407 INFO [StoreOpener-6f16e365fc2b4f8b47779b05bca52e32-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f16e365fc2b4f8b47779b05bca52e32 columnFamilyName cf 2023-09-23 01:03:31,407 INFO [StoreOpener-bb405ee2158d58f3a92735da4f90fada-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb405ee2158d58f3a92735da4f90fada columnFamilyName cf 2023-09-23 01:03:31,409 INFO [StoreOpener-6f16e365fc2b4f8b47779b05bca52e32-1] regionserver.HStore(310): Store=6f16e365fc2b4f8b47779b05bca52e32/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:31,409 INFO [StoreOpener-bb405ee2158d58f3a92735da4f90fada-1] regionserver.HStore(310): Store=bb405ee2158d58f3a92735da4f90fada/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-23 01:03:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:31,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:31,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:31,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb405ee2158d58f3a92735da4f90fada; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70404725, jitterRate=0.04911215603351593}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:31,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-23 01:03:31,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb405ee2158d58f3a92735da4f90fada: 2023-09-23 01:03:31,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f16e365fc2b4f8b47779b05bca52e32; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73608591, jitterRate=0.09685347974300385}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-23 01:03:31,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f16e365fc2b4f8b47779b05bca52e32: 2023-09-23 01:03:31,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada., pid=108, masterSystemTime=1695431011401 2023-09-23 01:03:31,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32., pid=109, masterSystemTime=1695431011401 2023-09-23 01:03:31,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,417 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bb405ee2158d58f3a92735da4f90fada, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,417 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431011417"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695431011417"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695431011417"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695431011417"}]},"ts":"1695431011417"} 2023-09-23 01:03:31,417 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6f16e365fc2b4f8b47779b05bca52e32, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,417 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431011417"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695431011417"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695431011417"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695431011417"}]},"ts":"1695431011417"} 2023-09-23 01:03:31,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-23 01:03:31,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure bb405ee2158d58f3a92735da4f90fada, server=jenkins-hbase4.apache.org,40973,1695430912916 in 169 msec 2023-09-23 01:03:31,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-23 01:03:31,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 6f16e365fc2b4f8b47779b05bca52e32, server=jenkins-hbase4.apache.org,35139,1695430912822 in 170 msec 2023-09-23 01:03:31,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, ASSIGN in 329 msec 2023-09-23 01:03:31,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-23 01:03:31,422 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, ASSIGN in 329 msec 2023-09-23 01:03:31,422 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-23 01:03:31,422 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431011422"}]},"ts":"1695431011422"} 2023-09-23 01:03:31,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-23 01:03:31,425 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-23 01:03:31,425 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-23 01:03:31,427 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 01:03:31,428 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:31,428 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:31,428 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:31,428 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:31,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:31,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:31,429 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:31,430 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-23 01:03:31,430 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 376 msec 2023-09-23 01:03:31,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-23 01:03:31,661 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-23 01:03:31,663 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,663 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,665 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:03:31,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 01:03:31,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695431011675 (current time:1695431011675). 2023-09-23 01:03:31,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:31,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x7e1359e3 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:31,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@558a0e1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:31,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:31,685 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:31,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e1359e3 to 127.0.0.1:64606 2023-09-23 01:03:31,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:31,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x3e740e16 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:31,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5a4c847a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:31,694 DEBUG [hconnection-0x5fb39bc1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:31,697 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:31,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:31,704 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:31,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e740e16 to 127.0.0.1:64606 2023-09-23 01:03:31,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:31,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 01:03:31,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:31,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 01:03:31,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 01:03:31,709 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 01:03:31,709 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695431611709 2023-09-23 01:03:31,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 01:03:31,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,710 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:31,710 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:31,711 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 01:03:31,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 01:03:31,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-23 01:03:31,713 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 01:03:31,713 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695431611713 2023-09-23 01:03:31,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,722 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 01:03:31,722 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:31,723 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 01:03:31,723 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 01:03:31,723 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,723 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,726 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:31,726 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:31,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:31,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:31,726 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:31,726 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,726 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,727 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,727 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 01:03:31,727 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 01:03:31,728 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:31,727 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 01:03:31,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 01:03:31,729 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:31,729 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:31,730 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 01:03:31,730 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 01:03:31,731 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 01:03:31,731 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 01:03:31,731 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 01:03:31,731 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 01:03:31,736 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,736 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:31,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:31,737 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,738 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,738 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ab20bc[Count = 1] remaining members to acquire global barrier 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:31,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:31,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 01:03:31,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63ab20bc[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:31,741 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 01:03:31,741 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 01:03:31,742 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 01:03:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,742 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 01:03:31,743 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 01:03:31,743 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:31,743 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,743 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:31,743 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:31,743 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:31,743 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,743 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:31,743 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:31,743 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,743 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. started... 2023-09-23 01:03:31,743 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. started... 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb405ee2158d58f3a92735da4f90fada: 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f16e365fc2b4f8b47779b05bca52e32: 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:03:31,745 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-23 01:03:31,745 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 01:03:31,745 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:31,746 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 01:03:31,760 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. completed. 2023-09-23 01:03:31,760 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:31,760 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:31,761 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:31,761 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,761 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 01:03:31,761 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:31,762 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 01:03:31,762 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,762 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:31,762 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 01:03:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:31,765 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. completed. 2023-09-23 01:03:31,765 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 01:03:31,765 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,767 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,767 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 01:03:31,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,767 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:31,767 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 01:03:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:03:31,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:31,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:03:31,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 01:03:31,774 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 01:03:31,774 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:31,774 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:31,774 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,774 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:31,775 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,775 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,775 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:31,776 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:31,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:31,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,777 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:31,778 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,779 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,779 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,779 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:31,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:31,783 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:31,783 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:31,785 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:31,783 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:31,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:31,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:31,785 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:03:31,785 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:31,785 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:31,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,786 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-23 01:03:31,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,811 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:31,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 01:03:31,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:03:31,812 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:03:31,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 01:03:31,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,820 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:31,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695431011709Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695431011795 (+86 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695431011795Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695431011795Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695431011798 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695431011814 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695431011820 (+6 ms) 2023-09-23 01:03:31,823 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 01:03:31,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 113 msec 2023-09-23 01:03:32,012 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:32,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 01:03:32,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:32,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40973] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:03:32,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35139] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. with WAL disabled. Data may be lost in the event of a crash. 2023-09-23 01:03:32,019 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,019 DEBUG [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:32,019 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-23 01:03:32,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 01:03:32,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695431012027 (current time:1695431012027). 2023-09-23 01:03:32,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-23 01:03:32,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x1fd52375 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:32,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c7bcedd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:32,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:32,041 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:32,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fd52375 to 127.0.0.1:64606 2023-09-23 01:03:32,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:32,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(139): Connect 0x17c0c2a8 to 127.0.0.1:64606 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-23 01:03:32,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@213895ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-23 01:03:32,049 DEBUG [hconnection-0x23b7aa72-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:32,052 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:32,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-23 01:03:32,057 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-23 01:03:32,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c0c2a8 to 127.0.0.1:64606 2023-09-23 01:03:32,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:03:32,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-23 01:03:32,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-23 01:03:32,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 01:03:32,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 01:03:32,062 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 01:03:32,063 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695431612063 2023-09-23 01:03:32,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-23 01:03:32,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,064 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-23 01:03:32,064 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-23 01:03:32,065 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-23 01:03:32,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 01:03:32,066 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-23 01:03:32,066 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 01:03:32,067 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695431612067 2023-09-23 01:03:32,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,075 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-23 01:03:32,075 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:32,076 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-23 01:03:32,076 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-23 01:03:32,077 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,077 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,078 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:32,078 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:32,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:32,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:32,078 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:32,078 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,078 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,078 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,079 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-23 01:03:32,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 01:03:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 01:03:32,079 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 01:03:32,084 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-23 01:03:32,084 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-23 01:03:32,085 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-23 01:03:32,085 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-23 01:03:32,086 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34471,1695430912871' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-23 01:03:32,087 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:32,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:32,087 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,087 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,088 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-23 01:03:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40973,1695430912916' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47bbaaae[Count = 1] remaining members to acquire global barrier 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,35139,1695430912822' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-23 01:03:32,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47bbaaae[Count = 0] remaining members to acquire global barrier 2023-09-23 01:03:32,091 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-23 01:03:32,091 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,095 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,095 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 01:03:32,096 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-23 01:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. started... 2023-09-23 01:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:32,096 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,096 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-23 01:03:32,096 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bb405ee2158d58f3a92735da4f90fada 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 01:03:32,096 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. started... 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34471,1695430912871' in zk 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:32,096 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-23 01:03:32,097 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f16e365fc2b4f8b47779b05bca52e32 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-23 01:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 01:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:32,098 DEBUG [member: 'jenkins-hbase4.apache.org,34471,1695430912871' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 01:03:32,112 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309233407ce2a16be49b48e6b75404f751e7a to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309233407ce2a16be49b48e6b75404f751e7a 2023-09-23 01:03:32,112 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230923593d239dfc52477e8496fceb654156ea to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923593d239dfc52477e8496fceb654156ea 2023-09-23 01:03:32,124 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/.tmp/cf/3350fe86371a43a5964791bb7d1855dd 2023-09-23 01:03:32,124 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/.tmp/cf/b41b5e4b59664f1182b639f6c146d078 2023-09-23 01:03:32,128 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/.tmp/cf/b41b5e4b59664f1182b639f6c146d078 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf/b41b5e4b59664f1182b639f6c146d078 2023-09-23 01:03:32,129 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/.tmp/cf/3350fe86371a43a5964791bb7d1855dd as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf/3350fe86371a43a5964791bb7d1855dd 2023-09-23 01:03:32,133 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf/b41b5e4b59664f1182b639f6c146d078, entries=2, sequenceid=6, filesize=5.2 K 2023-09-23 01:03:32,133 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf/3350fe86371a43a5964791bb7d1855dd, entries=48, sequenceid=6, filesize=13.5 K 2023-09-23 01:03:32,134 INFO [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for bb405ee2158d58f3a92735da4f90fada in 38ms, sequenceid=6, compaction requested=false 2023-09-23 01:03:32,134 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 01:03:32,134 INFO [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6f16e365fc2b4f8b47779b05bca52e32 in 38ms, sequenceid=6, compaction requested=false 2023-09-23 01:03:32,134 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bb405ee2158d58f3a92735da4f90fada: 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f16e365fc2b4f8b47779b05bca52e32: 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf/b41b5e4b59664f1182b639f6c146d078] hfiles 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf/3350fe86371a43a5964791bb7d1855dd] hfiles 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf/3350fe86371a43a5964791bb7d1855dd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,137 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf/b41b5e4b59664f1182b639f6c146d078 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,146 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. completed. 2023-09-23 01:03:32,146 DEBUG [rs(jenkins-hbase4.apache.org,35139,1695430912822)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:32,146 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:32,146 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:32,146 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,146 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 01:03:32,146 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,35139,1695430912822' in zk 2023-09-23 01:03:32,148 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,148 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 01:03:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:32,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:32,148 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:32,148 DEBUG [member: 'jenkins-hbase4.apache.org,35139,1695430912822' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 01:03:32,149 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. completed. 2023-09-23 01:03:32,149 DEBUG [rs(jenkins-hbase4.apache.org,40973,1695430912916)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:32,149 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-23 01:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-23 01:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-23 01:03:32,150 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40973,1695430912916' in zk 2023-09-23 01:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:32,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,151 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,151 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-23 01:03:32,151 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:32,151 DEBUG [member: 'jenkins-hbase4.apache.org,40973,1695430912916' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-23 01:03:32,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:32,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,35139,1695430912822': 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,35139,1695430912822' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:32,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:32,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40973,1695430912916': 2023-09-23 01:03:32,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40973,1695430912916' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-23 01:03:32,158 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-23 01:03:32,158 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-23 01:03:32,158 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-23 01:03:32,158 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,158 INFO [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-23 01:03:32,160 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,161 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,160 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:32,160 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:32,161 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-23 01:03:32,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:32,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,162 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,162 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-23 01:03:32,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-23 01:03:32,164 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,164 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,164 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:32,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,164 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 01:03:32,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-23 01:03:32,165 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-23 01:03:32,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:32,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-23 01:03:32,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-23 01:03:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:32,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-23 01:03:32,167 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:32,168 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,168 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-23 01:03:32,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-23 01:03:32,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,168 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:32,168 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,168 DEBUG [(jenkins-hbase4.apache.org,42795,1695430911629)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-23 01:03:32,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,168 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-23 01:03:32,169 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:32,169 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:03:32,169 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,169 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923593d239dfc52477e8496fceb654156ea, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309233407ce2a16be49b48e6b75404f751e7a] mob files 2023-09-23 01:03:32,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923593d239dfc52477e8496fceb654156ea 2023-09-23 01:03:32,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309233407ce2a16be49b48e6b75404f751e7a 2023-09-23 01:03:32,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,192 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,193 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-23 01:03:32,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,193 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695431012063Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695431012176 (+113 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695431012176Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695431012176Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695431012180 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695431012187 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695431012193 (+6 ms) 2023-09-23 01:03:32,196 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-23 01:03:32,197 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 132 msec 2023-09-23 01:03:32,365 DEBUG [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-23 01:03:32,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-23 01:03:32,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-23 01:03:32,367 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367 2023-09-23 01:03:32,367 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36407, tgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367, rawTgtDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367, srcFsUri=hdfs://localhost:36407, srcDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:03:32,388 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b 2023-09-23 01:03:32,388 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-709864774_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,388 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36407, inputRoot=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b, snapshotDir=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-23 01:03:32,400 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:32,423 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:32,424 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:32,424 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:32,424 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,305 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-8679691312461382722.jar 2023-09-23 01:03:33,306 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,306 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,372 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/hadoop-6252919538861434324.jar 2023-09-23 01:03:33,373 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,373 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-23 01:03:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-23 01:03:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-23 01:03:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-23 01:03:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-23 01:03:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-23 01:03:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-23 01:03:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-23 01:03:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-23 01:03:33,378 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-23 01:03:33,378 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-23 01:03:33,379 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:33,379 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:33,380 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:33,380 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:33,380 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-23 01:03:33,380 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:33,381 DEBUG [Listener at jenkins-hbase4.apache.org/33411] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-23 01:03:33,726 WARN [Listener at jenkins-hbase4.apache.org/33411] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-23 01:03:33,728 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-23 01:03:33,730 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-23 01:03:35,428 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:03:35,428 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-23 01:03:35,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0006_000001 (auth:SIMPLE) 2023-09-23 01:03:35,854 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0007_000001 (auth:SIMPLE) 2023-09-23 01:03:36,331 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:03:39,483 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0007_000001 (auth:SIMPLE) 2023-09-23 01:03:41,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0007_000001 (auth:SIMPLE) 2023-09-23 01:03:44,240 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695430919334_0007_000001 (auth:SIMPLE) 2023-09-23 01:03:45,911 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-23 01:03:45,911 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-23 01:03:45,922 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:45,922 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-23 01:03:45,923 INFO [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-23 01:03:45,923 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:45,923 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 01:03:45,923 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 01:03:45,923 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1487540844_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:45,924 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-23 01:03:45,924 DEBUG [Listener at jenkins-hbase4.apache.org/33411] snapshot.TestExportSnapshot(367): hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/export-test/export-1695431012367/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-23 01:03:45,930 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:45,930 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:45,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:45,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 01:03:45,934 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431025934"}]},"ts":"1695431025934"} 2023-09-23 01:03:45,935 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-23 01:03:45,936 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-23 01:03:45,937 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, UNASSIGN}] 2023-09-23 01:03:45,939 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, UNASSIGN 2023-09-23 01:03:45,939 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, UNASSIGN 2023-09-23 01:03:45,939 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bb405ee2158d58f3a92735da4f90fada, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:03:45,939 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6f16e365fc2b4f8b47779b05bca52e32, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:03:45,939 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431025939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431025939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431025939"}]},"ts":"1695431025939"} 2023-09-23 01:03:45,939 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431025939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695431025939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695431025939"}]},"ts":"1695431025939"} 2023-09-23 01:03:45,940 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure bb405ee2158d58f3a92735da4f90fada, server=jenkins-hbase4.apache.org,40973,1695430912916}] 2023-09-23 01:03:45,941 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 6f16e365fc2b4f8b47779b05bca52e32, server=jenkins-hbase4.apache.org,35139,1695430912822}] 2023-09-23 01:03:46,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 01:03:46,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:46,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:46,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f16e365fc2b4f8b47779b05bca52e32, disabling compactions & flushes 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb405ee2158d58f3a92735da4f90fada, disabling compactions & flushes 2023-09-23 01:03:46,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:46,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. after waiting 0 ms 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. after waiting 0 ms 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:46,093 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:46,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:46,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:03:46,104 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:46,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:03:46,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32. 2023-09-23 01:03:46,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f16e365fc2b4f8b47779b05bca52e32: 2023-09-23 01:03:46,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada. 2023-09-23 01:03:46,105 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb405ee2158d58f3a92735da4f90fada: 2023-09-23 01:03:46,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:46,107 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6f16e365fc2b4f8b47779b05bca52e32, regionState=CLOSED 2023-09-23 01:03:46,107 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431026107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431026107"}]},"ts":"1695431026107"} 2023-09-23 01:03:46,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:46,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bb405ee2158d58f3a92735da4f90fada, regionState=CLOSED 2023-09-23 01:03:46,108 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695431026107"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695431026107"}]},"ts":"1695431026107"} 2023-09-23 01:03:46,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-23 01:03:46,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 6f16e365fc2b4f8b47779b05bca52e32, server=jenkins-hbase4.apache.org,35139,1695430912822 in 167 msec 2023-09-23 01:03:46,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-23 01:03:46,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure bb405ee2158d58f3a92735da4f90fada, server=jenkins-hbase4.apache.org,40973,1695430912916 in 169 msec 2023-09-23 01:03:46,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6f16e365fc2b4f8b47779b05bca52e32, UNASSIGN in 173 msec 2023-09-23 01:03:46,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-23 01:03:46,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bb405ee2158d58f3a92735da4f90fada, UNASSIGN in 173 msec 2023-09-23 01:03:46,112 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695431026112"}]},"ts":"1695431026112"} 2023-09-23 01:03:46,113 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-23 01:03:46,119 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-23 01:03:46,120 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 189 msec 2023-09-23 01:03:46,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-23 01:03:46,236 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-23 01:03:46,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,240 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,241 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34471] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,243 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:46,243 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:46,244 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,244 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,244 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,244 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 01:03:46,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 01:03:46,244 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 01:03:46,245 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-23 01:03:46,245 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/recovered.edits] 2023-09-23 01:03:46,245 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf, FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/recovered.edits] 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:46,246 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-23 01:03:46,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 01:03:46,249 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf/b41b5e4b59664f1182b639f6c146d078 to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/cf/b41b5e4b59664f1182b639f6c146d078 2023-09-23 01:03:46,249 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf/3350fe86371a43a5964791bb7d1855dd to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/cf/3350fe86371a43a5964791bb7d1855dd 2023-09-23 01:03:46,252 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada/recovered.edits/9.seqid 2023-09-23 01:03:46,252 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/recovered.edits/9.seqid to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32/recovered.edits/9.seqid 2023-09-23 01:03:46,253 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bb405ee2158d58f3a92735da4f90fada 2023-09-23 01:03:46,253 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6f16e365fc2b4f8b47779b05bca52e32 2023-09-23 01:03:46,253 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-23 01:03:46,253 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 01:03:46,254 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-23 01:03:46,257 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923593d239dfc52477e8496fceb654156ea to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230923593d239dfc52477e8496fceb654156ea 2023-09-23 01:03:46,258 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309233407ce2a16be49b48e6b75404f751e7a to hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309233407ce2a16be49b48e6b75404f751e7a 2023-09-23 01:03:46,259 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-23 01:03:46,261 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,262 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-23 01:03:46,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-23 01:03:46,265 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,265 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-23 01:03:46,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695431026265"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:46,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695431026265"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:46,267 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-23 01:03:46,267 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bb405ee2158d58f3a92735da4f90fada, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695431011052.bb405ee2158d58f3a92735da4f90fada.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6f16e365fc2b4f8b47779b05bca52e32, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695431011052.6f16e365fc2b4f8b47779b05bca52e32.', STARTKEY => '1', ENDKEY => ''}] 2023-09-23 01:03:46,267 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-23 01:03:46,267 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695431026267"}]},"ts":"9223372036854775807"} 2023-09-23 01:03:46,268 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-23 01:03:46,270 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-23 01:03:46,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-23 01:03:46,348 INFO [Listener at jenkins-hbase4.apache.org/33411] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-23 01:03:46,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 01:03:46,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-23 01:03:46,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42795] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-23 01:03:46,386 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:48598 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5330 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_105445951_1 at /127.0.0.1:42098 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1778af6b-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:39486 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1034720990) connection to jenkins-hbase4.apache.org/172.31.14.131:37017 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_105445951_1 at /127.0.0.1:48452 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1487540844_17 at /127.0.0.1:51094 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 947), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 155) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=1008 (was 1075) 2023-09-23 01:03:46,387 WARN [Listener at jenkins-hbase4.apache.org/33411] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-23 01:03:46,387 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-23 01:03:46,398 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 01:03:46,508 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695430919334_0007_01_000001 is : 143 2023-09-23 01:03:51,675 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-23 01:04:00,524 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 01:04:14,644 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 01:04:14,644 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 01:04:14,758 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-23 01:04:14,767 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-23 01:04:14,768 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 01:04:14,776 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-23 01:04:14,879 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-23 01:04:14,880 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-23 01:04:14,880 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-23 01:04:14,880 INFO [Listener at jenkins-hbase4.apache.org/33411] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-23 01:04:14,880 DEBUG [Listener at jenkins-hbase4.apache.org/33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21c22958 to 127.0.0.1:64606 2023-09-23 01:04:14,880 DEBUG [Listener at jenkins-hbase4.apache.org/33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:14,880 DEBUG [Listener at jenkins-hbase4.apache.org/33411] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-23 01:04:14,881 DEBUG [Listener at jenkins-hbase4.apache.org/33411] util.JVMClusterUtil(257): Found active master hash=697902412, stopped=false 2023-09-23 01:04:14,881 DEBUG [Listener at jenkins-hbase4.apache.org/33411] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,881 DEBUG [Listener at jenkins-hbase4.apache.org/33411] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-23 01:04:14,881 INFO [Listener at jenkins-hbase4.apache.org/33411] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:04:14,882 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 01:04:14,882 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 01:04:14,882 INFO [Listener at jenkins-hbase4.apache.org/33411] procedure2.ProcedureExecutor(628): Stopping 2023-09-23 01:04:14,882 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-23 01:04:14,882 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 01:04:14,882 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-23 01:04:14,883 DEBUG [Listener at jenkins-hbase4.apache.org/33411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eb63c24 to 127.0.0.1:64606 2023-09-23 01:04:14,883 DEBUG [Listener at jenkins-hbase4.apache.org/33411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:14,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:04:14,883 INFO [Listener at jenkins-hbase4.apache.org/33411] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,35139,1695430912822' ***** 2023-09-23 01:04:14,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:04:14,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:04:14,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-23 01:04:14,883 DEBUG [Listener at jenkins-hbase4.apache.org/33411] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,883 INFO [Listener at jenkins-hbase4.apache.org/33411] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 01:04:14,884 INFO [Listener at jenkins-hbase4.apache.org/33411] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34471,1695430912871' ***** 2023-09-23 01:04:14,884 DEBUG [Listener at jenkins-hbase4.apache.org/33411] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,884 INFO [Listener at jenkins-hbase4.apache.org/33411] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 01:04:14,884 INFO [RS:0;jenkins-hbase4:35139] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 01:04:14,884 INFO [Listener at jenkins-hbase4.apache.org/33411] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40973,1695430912916' ***** 2023-09-23 01:04:14,884 INFO [RS:1;jenkins-hbase4:34471] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 01:04:14,884 DEBUG [Listener at jenkins-hbase4.apache.org/33411] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,884 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 01:04:14,884 INFO [Listener at jenkins-hbase4.apache.org/33411] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-23 01:04:14,884 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 01:04:14,884 INFO [RS:1;jenkins-hbase4:34471] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 01:04:14,884 INFO [RS:2;jenkins-hbase4:40973] regionserver.HeapMemoryManager(220): Stopping 2023-09-23 01:04:14,884 INFO [RS:1;jenkins-hbase4:34471] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 01:04:14,884 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-23 01:04:14,884 INFO [RS:0;jenkins-hbase4:35139] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 01:04:14,884 INFO [RS:2;jenkins-hbase4:40973] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-23 01:04:14,885 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(3305): Received CLOSE for 796811673120186992f91cc2ce1d423b 2023-09-23 01:04:14,884 INFO [RS:0;jenkins-hbase4:35139] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 01:04:14,885 INFO [RS:2;jenkins-hbase4:40973] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-23 01:04:14,885 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:04:14,885 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(3305): Received CLOSE for 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:04:14,885 DEBUG [RS:2;jenkins-hbase4:40973] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09c10f09 to 127.0.0.1:64606 2023-09-23 01:04:14,885 DEBUG [RS:2;jenkins-hbase4:40973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:14,885 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:04:14,885 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:04:14,885 DEBUG [RS:1;jenkins-hbase4:34471] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x798a598e to 127.0.0.1:64606 2023-09-23 01:04:14,885 DEBUG [RS:0;jenkins-hbase4:35139] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3340701e to 127.0.0.1:64606 2023-09-23 01:04:14,885 DEBUG [RS:1;jenkins-hbase4:34471] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:14,885 DEBUG [RS:0;jenkins-hbase4:35139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:14,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 796811673120186992f91cc2ce1d423b, disabling compactions & flushes 2023-09-23 01:04:14,888 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 01:04:14,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2916ba6bb16b1912c7747fea582d98f1, disabling compactions & flushes 2023-09-23 01:04:14,888 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1478): Online Regions={2916ba6bb16b1912c7747fea582d98f1=hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1.} 2023-09-23 01:04:14,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:04:14,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:04:14,888 INFO [RS:2;jenkins-hbase4:40973] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 01:04:14,888 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 01:04:14,888 INFO [RS:2;jenkins-hbase4:40973] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 01:04:14,888 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1478): Online Regions={796811673120186992f91cc2ce1d423b=hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b.} 2023-09-23 01:04:14,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:04:14,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:04:14,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. after waiting 0 ms 2023-09-23 01:04:14,888 INFO [RS:2;jenkins-hbase4:40973] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 01:04:14,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:04:14,888 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-23 01:04:14,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. after waiting 0 ms 2023-09-23 01:04:14,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 796811673120186992f91cc2ce1d423b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-23 01:04:14,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:04:14,888 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-23 01:04:14,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2916ba6bb16b1912c7747fea582d98f1 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-23 01:04:14,889 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-23 01:04:14,889 DEBUG [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-23 01:04:14,889 DEBUG [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1504): Waiting on 2916ba6bb16b1912c7747fea582d98f1 2023-09-23 01:04:14,889 DEBUG [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1504): Waiting on 796811673120186992f91cc2ce1d423b 2023-09-23 01:04:14,889 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-23 01:04:14,890 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-23 01:04:14,890 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-23 01:04:14,890 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-23 01:04:14,890 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-23 01:04:14,890 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-23 01:04:14,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/.tmp/info/ab2696cc965e49329e826b749675279b 2023-09-23 01:04:14,905 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/.tmp/info/2ee01d79ef274e9ea8f865e9ed2290b5 2023-09-23 01:04:14,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/.tmp/l/70c7bbecef894836a5c170dbc3fb4526 2023-09-23 01:04:14,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70c7bbecef894836a5c170dbc3fb4526 2023-09-23 01:04:14,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ee01d79ef274e9ea8f865e9ed2290b5 2023-09-23 01:04:14,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/.tmp/l/70c7bbecef894836a5c170dbc3fb4526 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/l/70c7bbecef894836a5c170dbc3fb4526 2023-09-23 01:04:14,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70c7bbecef894836a5c170dbc3fb4526 2023-09-23 01:04:14,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/l/70c7bbecef894836a5c170dbc3fb4526, entries=7, sequenceid=18, filesize=5.2 K 2023-09-23 01:04:14,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 796811673120186992f91cc2ce1d423b in 30ms, sequenceid=18, compaction requested=false 2023-09-23 01:04:14,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/.tmp/rep_barrier/261c4428da204e179123c775a4a77426 2023-09-23 01:04:14,922 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/.tmp/info/ab2696cc965e49329e826b749675279b as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/info/ab2696cc965e49329e826b749675279b 2023-09-23 01:04:14,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/acl/796811673120186992f91cc2ce1d423b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-23 01:04:14,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:04:14,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 796811673120186992f91cc2ce1d423b: 2023-09-23 01:04:14,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695430915756.796811673120186992f91cc2ce1d423b. 2023-09-23 01:04:14,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 261c4428da204e179123c775a4a77426 2023-09-23 01:04:14,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/info/ab2696cc965e49329e826b749675279b, entries=2, sequenceid=6, filesize=4.8 K 2023-09-23 01:04:14,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 2916ba6bb16b1912c7747fea582d98f1 in 40ms, sequenceid=6, compaction requested=false 2023-09-23 01:04:14,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/namespace/2916ba6bb16b1912c7747fea582d98f1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-23 01:04:14,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:04:14,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2916ba6bb16b1912c7747fea582d98f1: 2023-09-23 01:04:14,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695430915010.2916ba6bb16b1912c7747fea582d98f1. 2023-09-23 01:04:14,945 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/.tmp/table/c9d569394b7b4cb9a20902dac2cdc026 2023-09-23 01:04:14,948 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9d569394b7b4cb9a20902dac2cdc026 2023-09-23 01:04:14,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/.tmp/info/2ee01d79ef274e9ea8f865e9ed2290b5 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/info/2ee01d79ef274e9ea8f865e9ed2290b5 2023-09-23 01:04:14,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ee01d79ef274e9ea8f865e9ed2290b5 2023-09-23 01:04:14,953 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/info/2ee01d79ef274e9ea8f865e9ed2290b5, entries=48, sequenceid=131, filesize=10.3 K 2023-09-23 01:04:14,954 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/.tmp/rep_barrier/261c4428da204e179123c775a4a77426 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/rep_barrier/261c4428da204e179123c775a4a77426 2023-09-23 01:04:14,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 261c4428da204e179123c775a4a77426 2023-09-23 01:04:14,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/rep_barrier/261c4428da204e179123c775a4a77426, entries=13, sequenceid=131, filesize=6.4 K 2023-09-23 01:04:14,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/.tmp/table/c9d569394b7b4cb9a20902dac2cdc026 as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/table/c9d569394b7b4cb9a20902dac2cdc026 2023-09-23 01:04:14,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c9d569394b7b4cb9a20902dac2cdc026 2023-09-23 01:04:14,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/table/c9d569394b7b4cb9a20902dac2cdc026, entries=24, sequenceid=131, filesize=6.9 K 2023-09-23 01:04:14,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 73ms, sequenceid=131, compaction requested=false 2023-09-23 01:04:14,974 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-23 01:04:14,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-23 01:04:14,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-23 01:04:14,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-23 01:04:14,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-23 01:04:14,975 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-23 01:04:14,981 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 01:04:14,981 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 01:04:14,981 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-23 01:04:15,090 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40973,1695430912916; all regions closed. 2023-09-23 01:04:15,090 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34471,1695430912871; all regions closed. 2023-09-23 01:04:15,090 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,35139,1695430912822; all regions closed. 2023-09-23 01:04:15,102 DEBUG [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs 2023-09-23 01:04:15,103 INFO [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40973%2C1695430912916.meta:.meta(num 1695430914695) 2023-09-23 01:04:15,103 DEBUG [RS:1;jenkins-hbase4:34471] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs 2023-09-23 01:04:15,103 INFO [RS:1;jenkins-hbase4:34471] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34471%2C1695430912871:(num 1695430914587) 2023-09-23 01:04:15,103 DEBUG [RS:0;jenkins-hbase4:35139] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs 2023-09-23 01:04:15,103 INFO [RS:0;jenkins-hbase4:35139] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35139%2C1695430912822:(num 1695430914587) 2023-09-23 01:04:15,103 DEBUG [RS:1;jenkins-hbase4:34471] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:15,103 DEBUG [RS:0;jenkins-hbase4:35139] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:15,103 INFO [RS:1;jenkins-hbase4:34471] regionserver.LeaseManager(133): Closed leases 2023-09-23 01:04:15,103 INFO [RS:0;jenkins-hbase4:35139] regionserver.LeaseManager(133): Closed leases 2023-09-23 01:04:15,103 INFO [RS:0;jenkins-hbase4:35139] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-23 01:04:15,103 INFO [RS:1;jenkins-hbase4:34471] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-23 01:04:15,104 INFO [RS:1;jenkins-hbase4:34471] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 01:04:15,104 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 01:04:15,104 INFO [RS:0;jenkins-hbase4:35139] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-23 01:04:15,104 INFO [RS:0;jenkins-hbase4:35139] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 01:04:15,104 INFO [RS:0;jenkins-hbase4:35139] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 01:04:15,104 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 01:04:15,104 INFO [RS:1;jenkins-hbase4:34471] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-23 01:04:15,104 INFO [RS:1;jenkins-hbase4:34471] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-23 01:04:15,106 INFO [RS:1;jenkins-hbase4:34471] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34471 2023-09-23 01:04:15,106 INFO [RS:0;jenkins-hbase4:35139] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35139 2023-09-23 01:04:15,110 DEBUG [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/oldWALs 2023-09-23 01:04:15,110 INFO [RS:2;jenkins-hbase4:40973] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40973%2C1695430912916:(num 1695430914587) 2023-09-23 01:04:15,110 DEBUG [RS:2;jenkins-hbase4:40973] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:15,110 INFO [RS:2;jenkins-hbase4:40973] regionserver.LeaseManager(133): Closed leases 2023-09-23 01:04:15,110 INFO [RS:2;jenkins-hbase4:40973] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-23 01:04:15,110 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 01:04:15,111 INFO [RS:2;jenkins-hbase4:40973] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40973 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34471,1695430912871 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:04:15,114 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-23 01:04:15,115 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40973,1695430912916 2023-09-23 01:04:15,115 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:04:15,115 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:04:15,115 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35139,1695430912822 2023-09-23 01:04:15,117 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35139,1695430912822] 2023-09-23 01:04:15,117 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35139,1695430912822; numProcessing=1 2023-09-23 01:04:15,118 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35139,1695430912822 already deleted, retry=false 2023-09-23 01:04:15,118 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,35139,1695430912822 expired; onlineServers=2 2023-09-23 01:04:15,118 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34471,1695430912871] 2023-09-23 01:04:15,118 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34471,1695430912871; numProcessing=2 2023-09-23 01:04:15,119 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34471,1695430912871 already deleted, retry=false 2023-09-23 01:04:15,119 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34471,1695430912871 expired; onlineServers=1 2023-09-23 01:04:15,119 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40973,1695430912916] 2023-09-23 01:04:15,119 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40973,1695430912916; numProcessing=3 2023-09-23 01:04:15,121 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40973,1695430912916 already deleted, retry=false 2023-09-23 01:04:15,121 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40973,1695430912916 expired; onlineServers=0 2023-09-23 01:04:15,121 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42795,1695430911629' ***** 2023-09-23 01:04:15,121 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-23 01:04:15,121 DEBUG [M:0;jenkins-hbase4:42795] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68a42f77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-23 01:04:15,121 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42795,1695430911629 2023-09-23 01:04:15,121 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42795,1695430911629; all regions closed. 2023-09-23 01:04:15,121 DEBUG [M:0;jenkins-hbase4:42795] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-23 01:04:15,121 DEBUG [M:0;jenkins-hbase4:42795] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-23 01:04:15,121 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-23 01:04:15,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695430914166] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695430914166,5,FailOnTimeoutGroup] 2023-09-23 01:04:15,121 DEBUG [M:0;jenkins-hbase4:42795] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-23 01:04:15,121 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695430914167] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695430914167,5,FailOnTimeoutGroup] 2023-09-23 01:04:15,122 INFO [M:0;jenkins-hbase4:42795] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-23 01:04:15,122 INFO [M:0;jenkins-hbase4:42795] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-23 01:04:15,122 INFO [M:0;jenkins-hbase4:42795] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-23 01:04:15,122 DEBUG [M:0;jenkins-hbase4:42795] master.HMaster(1512): Stopping service threads 2023-09-23 01:04:15,122 INFO [M:0;jenkins-hbase4:42795] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-23 01:04:15,122 ERROR [M:0;jenkins-hbase4:42795] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-09-23 01:04:15,122 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-23 01:04:15,122 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-23 01:04:15,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-23 01:04:15,123 INFO [M:0;jenkins-hbase4:42795] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-23 01:04:15,123 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-23 01:04:15,123 DEBUG [M:0;jenkins-hbase4:42795] zookeeper.ZKUtil(398): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-23 01:04:15,123 WARN [M:0;jenkins-hbase4:42795] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-23 01:04:15,123 INFO [M:0;jenkins-hbase4:42795] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-23 01:04:15,123 INFO [M:0;jenkins-hbase4:42795] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-23 01:04:15,124 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-23 01:04:15,124 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:04:15,124 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:04:15,124 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-23 01:04:15,124 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:04:15,124 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.70 KB heapSize=451.98 KB 2023-09-23 01:04:15,137 INFO [M:0;jenkins-hbase4:42795] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.70 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b40ea8af9ee424991e514046345936c 2023-09-23 01:04:15,141 INFO [M:0;jenkins-hbase4:42795] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b40ea8af9ee424991e514046345936c 2023-09-23 01:04:15,141 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b40ea8af9ee424991e514046345936c as hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b40ea8af9ee424991e514046345936c 2023-09-23 01:04:15,145 INFO [M:0;jenkins-hbase4:42795] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b40ea8af9ee424991e514046345936c 2023-09-23 01:04:15,145 INFO [M:0;jenkins-hbase4:42795] regionserver.HStore(1080): Added hdfs://localhost:36407/user/jenkins/test-data/79047237-7cf2-0131-5e73-5f18c837535b/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b40ea8af9ee424991e514046345936c, entries=119, sequenceid=899, filesize=28.6 K 2023-09-23 01:04:15,146 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(2948): Finished flush of dataSize ~375.70 KB/384716, heapSize ~451.96 KB/462808, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-09-23 01:04:15,148 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-23 01:04:15,148 DEBUG [M:0;jenkins-hbase4:42795] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-23 01:04:15,152 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-23 01:04:15,152 INFO [M:0;jenkins-hbase4:42795] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-23 01:04:15,152 INFO [M:0;jenkins-hbase4:42795] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42795 2023-09-23 01:04:15,154 DEBUG [M:0;jenkins-hbase4:42795] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42795,1695430911629 already deleted, retry=false 2023-09-23 01:04:15,217 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,217 INFO [RS:2;jenkins-hbase4:40973] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40973,1695430912916; zookeeper connection closed. 2023-09-23 01:04:15,217 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:40973-0x100d64dda910003, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,217 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3e097e74] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3e097e74 2023-09-23 01:04:15,317 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,317 INFO [M:0;jenkins-hbase4:42795] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42795,1695430911629; zookeeper connection closed. 2023-09-23 01:04:15,317 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): master:42795-0x100d64dda910000, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,417 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,417 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:35139-0x100d64dda910001, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,417 INFO [RS:0;jenkins-hbase4:35139] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,35139,1695430912822; zookeeper connection closed. 2023-09-23 01:04:15,418 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6970751d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6970751d 2023-09-23 01:04:15,518 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,518 INFO [RS:1;jenkins-hbase4:34471] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34471,1695430912871; zookeeper connection closed. 2023-09-23 01:04:15,518 DEBUG [Listener at localhost/46467-EventThread] zookeeper.ZKWatcher(600): regionserver:34471-0x100d64dda910002, quorum=127.0.0.1:64606, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-23 01:04:15,518 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22361d3b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22361d3b 2023-09-23 01:04:15,518 INFO [Listener at jenkins-hbase4.apache.org/33411] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-23 01:04:15,519 WARN [Listener at jenkins-hbase4.apache.org/33411] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 01:04:15,521 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 01:04:15,625 WARN [BP-1587590207-172.31.14.131-1695430907920 heartbeating to localhost/127.0.0.1:36407] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 01:04:15,625 WARN [BP-1587590207-172.31.14.131-1695430907920 heartbeating to localhost/127.0.0.1:36407] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1587590207-172.31.14.131-1695430907920 (Datanode Uuid 24852377-b8eb-47e9-a463-58ccc32708a2) service to localhost/127.0.0.1:36407 2023-09-23 01:04:15,627 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data5/current/BP-1587590207-172.31.14.131-1695430907920] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 01:04:15,627 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data6/current/BP-1587590207-172.31.14.131-1695430907920] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 01:04:15,628 WARN [Listener at jenkins-hbase4.apache.org/33411] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 01:04:15,630 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 01:04:15,733 WARN [BP-1587590207-172.31.14.131-1695430907920 heartbeating to localhost/127.0.0.1:36407] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 01:04:15,733 WARN [BP-1587590207-172.31.14.131-1695430907920 heartbeating to localhost/127.0.0.1:36407] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1587590207-172.31.14.131-1695430907920 (Datanode Uuid 1c4827ef-7805-4dae-93d5-79b7ade8b030) service to localhost/127.0.0.1:36407 2023-09-23 01:04:15,733 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data3/current/BP-1587590207-172.31.14.131-1695430907920] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 01:04:15,734 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data4/current/BP-1587590207-172.31.14.131-1695430907920] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 01:04:15,734 WARN [Listener at jenkins-hbase4.apache.org/33411] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-23 01:04:15,737 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 01:04:15,840 WARN [BP-1587590207-172.31.14.131-1695430907920 heartbeating to localhost/127.0.0.1:36407] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-23 01:04:15,840 WARN [BP-1587590207-172.31.14.131-1695430907920 heartbeating to localhost/127.0.0.1:36407] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1587590207-172.31.14.131-1695430907920 (Datanode Uuid 2a2003a1-fd9e-46f8-86e1-a18360bbc147) service to localhost/127.0.0.1:36407 2023-09-23 01:04:15,840 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data1/current/BP-1587590207-172.31.14.131-1695430907920] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 01:04:15,841 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/61496986-dc97-1a9e-3820-4593f4156c40/cluster_aace3e25-84fc-ab7f-6827-59f425f7ac24/dfs/data/data2/current/BP-1587590207-172.31.14.131-1695430907920] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-23 01:04:15,863 INFO [Listener at jenkins-hbase4.apache.org/33411] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-23 01:04:15,989 INFO [Listener at jenkins-hbase4.apache.org/33411] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-23 01:04:16,074 INFO [Listener at jenkins-hbase4.apache.org/33411] hbase.HBaseTestingUtility(1293): Minicluster is down