2023-09-18 10:01:09,702 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-18 10:01:09,910 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355 2023-09-18 10:01:09,910 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-18 10:01:09,911 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-18 10:01:09,951 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-18 10:01:10,200 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-18 10:01:10,201 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6, deleteOnExit=true 2023-09-18 10:01:10,201 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-18 10:01:10,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/test.cache.data in system properties and HBase conf 2023-09-18 10:01:10,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop.tmp.dir in system properties and HBase conf 2023-09-18 10:01:10,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop.log.dir in system properties and HBase conf 2023-09-18 10:01:10,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-18 10:01:10,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-18 10:01:10,203 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-18 10:01:10,529 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-18 10:01:10,534 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-18 10:01:10,535 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-18 10:01:10,535 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-18 10:01:10,535 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-18 10:01:10,535 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-18 10:01:10,536 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-18 10:01:10,536 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-18 10:01:10,536 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-18 10:01:10,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-18 10:01:10,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/nfs.dump.dir in system properties and HBase conf 2023-09-18 10:01:10,537 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir in system properties and HBase conf 2023-09-18 10:01:10,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-18 10:01:10,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-18 10:01:10,538 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-18 10:01:11,040 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-18 10:01:11,045 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-18 10:01:11,362 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-18 10:01:11,557 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-18 10:01:11,571 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:11,610 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:11,645 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_localhost_45399_hdfs____my7k7w/webapp 2023-09-18 10:01:11,793 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45399 2023-09-18 10:01:11,849 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-18 10:01:11,849 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-18 10:01:12,331 WARN [Listener at localhost/44901] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-18 10:01:12,408 WARN [Listener at localhost/44901] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-18 10:01:12,433 WARN [Listener at localhost/44901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:12,442 INFO [Listener at localhost/44901] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:12,450 INFO [Listener at localhost/44901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_localhost_41699_datanode____zda5k0/webapp 2023-09-18 10:01:12,555 INFO [Listener at localhost/44901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41699 2023-09-18 10:01:12,990 WARN [Listener at localhost/36121] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-18 10:01:13,004 WARN [Listener at localhost/36121] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-18 10:01:13,008 WARN [Listener at localhost/36121] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:13,010 INFO [Listener at localhost/36121] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:13,019 INFO [Listener at localhost/36121] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_localhost_36207_datanode____r0ze59/webapp 2023-09-18 10:01:13,130 INFO [Listener at localhost/36121] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36207 2023-09-18 10:01:13,145 WARN [Listener at localhost/35535] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-18 10:01:13,165 WARN [Listener at localhost/35535] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-18 10:01:13,172 WARN [Listener at localhost/35535] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:13,174 INFO [Listener at localhost/35535] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:13,184 INFO [Listener at localhost/35535] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_localhost_46787_datanode____.yvp9id/webapp 2023-09-18 10:01:13,316 INFO [Listener at localhost/35535] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46787 2023-09-18 10:01:13,327 WARN [Listener at localhost/42845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-18 10:01:13,679 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4724cb84db7a37d2: Processing first storage report for DS-f76cc108-81e0-4260-83ff-6b5e216067e2 from datanode 4d03d732-543d-466f-b418-11a6a0b34019 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4724cb84db7a37d2: from storage DS-f76cc108-81e0-4260-83ff-6b5e216067e2 node DatanodeRegistration(127.0.0.1:46027, datanodeUuid=4d03d732-543d-466f-b418-11a6a0b34019, infoPort=44619, infoSecurePort=0, ipcPort=35535, storageInfo=lv=-57;cid=testClusterID;nsid=1379087667;c=1695031271128), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x250a9552216ea3ad: Processing first storage report for DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2 from datanode 49b7499c-7eb9-4c66-8493-18afc0b5702e 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x250a9552216ea3ad: from storage DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2 node DatanodeRegistration(127.0.0.1:43295, datanodeUuid=49b7499c-7eb9-4c66-8493-18afc0b5702e, infoPort=36059, infoSecurePort=0, ipcPort=42845, storageInfo=lv=-57;cid=testClusterID;nsid=1379087667;c=1695031271128), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42047e68c6a0403f: Processing first storage report for DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485 from datanode f2be06be-dadf-4fb4-bdd3-5827c973fe33 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42047e68c6a0403f: from storage DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485 node DatanodeRegistration(127.0.0.1:44477, datanodeUuid=f2be06be-dadf-4fb4-bdd3-5827c973fe33, infoPort=38717, infoSecurePort=0, ipcPort=36121, storageInfo=lv=-57;cid=testClusterID;nsid=1379087667;c=1695031271128), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4724cb84db7a37d2: Processing first storage report for DS-096d5f10-bf26-41be-8112-a422aaf30c62 from datanode 4d03d732-543d-466f-b418-11a6a0b34019 2023-09-18 10:01:13,681 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4724cb84db7a37d2: from storage DS-096d5f10-bf26-41be-8112-a422aaf30c62 node DatanodeRegistration(127.0.0.1:46027, datanodeUuid=4d03d732-543d-466f-b418-11a6a0b34019, infoPort=44619, infoSecurePort=0, ipcPort=35535, storageInfo=lv=-57;cid=testClusterID;nsid=1379087667;c=1695031271128), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-18 10:01:13,682 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x250a9552216ea3ad: Processing first storage report for DS-c9476c23-b08f-4206-b097-e0953a0a7a62 from datanode 49b7499c-7eb9-4c66-8493-18afc0b5702e 2023-09-18 10:01:13,682 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x250a9552216ea3ad: from storage DS-c9476c23-b08f-4206-b097-e0953a0a7a62 node DatanodeRegistration(127.0.0.1:43295, datanodeUuid=49b7499c-7eb9-4c66-8493-18afc0b5702e, infoPort=36059, infoSecurePort=0, ipcPort=42845, storageInfo=lv=-57;cid=testClusterID;nsid=1379087667;c=1695031271128), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-18 10:01:13,682 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x42047e68c6a0403f: Processing first storage report for DS-91a0a09e-1c68-4797-bedd-be7d1d369b90 from datanode f2be06be-dadf-4fb4-bdd3-5827c973fe33 2023-09-18 10:01:13,682 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x42047e68c6a0403f: from storage DS-91a0a09e-1c68-4797-bedd-be7d1d369b90 node DatanodeRegistration(127.0.0.1:44477, datanodeUuid=f2be06be-dadf-4fb4-bdd3-5827c973fe33, infoPort=38717, infoSecurePort=0, ipcPort=36121, storageInfo=lv=-57;cid=testClusterID;nsid=1379087667;c=1695031271128), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-18 10:01:13,876 DEBUG [Listener at localhost/42845] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355 2023-09-18 10:01:13,963 INFO [Listener at localhost/42845] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/zookeeper_0, clientPort=57492, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-18 10:01:13,983 INFO [Listener at localhost/42845] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57492 2023-09-18 10:01:13,991 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:13,993 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:14,698 INFO [Listener at localhost/42845] util.FSUtils(471): Created version file at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 with version=8 2023-09-18 10:01:14,698 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/hbase-staging 2023-09-18 10:01:15,063 INFO [Listener at localhost/42845] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-18 10:01:15,608 INFO [Listener at localhost/42845] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-18 10:01:15,641 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:15,642 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:15,642 INFO [Listener at localhost/42845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-18 10:01:15,642 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:15,642 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-18 10:01:15,790 INFO [Listener at localhost/42845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-18 10:01:15,864 DEBUG [Listener at localhost/42845] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-18 10:01:15,958 INFO [Listener at localhost/42845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34087 2023-09-18 10:01:15,972 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:15,974 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:15,998 INFO [Listener at localhost/42845] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34087 connecting to ZooKeeper ensemble=127.0.0.1:57492 2023-09-18 10:01:16,058 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:340870x0, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-18 10:01:16,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34087-0x100be7be17d0000 connected 2023-09-18 10:01:16,095 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-18 10:01:16,096 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:01:16,110 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-18 10:01:16,118 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34087 2023-09-18 10:01:16,118 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34087 2023-09-18 10:01:16,119 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34087 2023-09-18 10:01:16,120 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34087 2023-09-18 10:01:16,120 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34087 2023-09-18 10:01:16,126 INFO [Listener at localhost/42845] master.HMaster(444): hbase.rootdir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, hbase.cluster.distributed=false 2023-09-18 10:01:16,192 INFO [Listener at localhost/42845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-18 10:01:16,192 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,192 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,192 INFO [Listener at localhost/42845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-18 10:01:16,193 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,193 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-18 10:01:16,197 INFO [Listener at localhost/42845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-18 10:01:16,200 INFO [Listener at localhost/42845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34469 2023-09-18 10:01:16,203 INFO [Listener at localhost/42845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-18 10:01:16,210 INFO [Listener at localhost/42845] mob.MobFileCache(124): MobFileCache disabled 2023-09-18 10:01:16,211 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,213 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,215 INFO [Listener at localhost/42845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34469 connecting to ZooKeeper ensemble=127.0.0.1:57492 2023-09-18 10:01:16,219 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:344690x0, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-18 10:01:16,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34469-0x100be7be17d0001 connected 2023-09-18 10:01:16,221 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-18 10:01:16,222 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:01:16,223 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-18 10:01:16,225 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34469 2023-09-18 10:01:16,225 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34469 2023-09-18 10:01:16,225 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34469 2023-09-18 10:01:16,230 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34469 2023-09-18 10:01:16,231 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34469 2023-09-18 10:01:16,251 INFO [Listener at localhost/42845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-18 10:01:16,251 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,252 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,252 INFO [Listener at localhost/42845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-18 10:01:16,253 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,253 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-18 10:01:16,253 INFO [Listener at localhost/42845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-18 10:01:16,255 INFO [Listener at localhost/42845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33575 2023-09-18 10:01:16,256 INFO [Listener at localhost/42845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-18 10:01:16,257 INFO [Listener at localhost/42845] mob.MobFileCache(124): MobFileCache disabled 2023-09-18 10:01:16,258 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,261 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,264 INFO [Listener at localhost/42845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33575 connecting to ZooKeeper ensemble=127.0.0.1:57492 2023-09-18 10:01:16,270 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:335750x0, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-18 10:01:16,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33575-0x100be7be17d0002 connected 2023-09-18 10:01:16,271 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-18 10:01:16,272 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:01:16,273 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-18 10:01:16,273 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33575 2023-09-18 10:01:16,277 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33575 2023-09-18 10:01:16,277 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33575 2023-09-18 10:01:16,280 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33575 2023-09-18 10:01:16,280 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33575 2023-09-18 10:01:16,293 INFO [Listener at localhost/42845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-18 10:01:16,293 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,294 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,294 INFO [Listener at localhost/42845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-18 10:01:16,294 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-18 10:01:16,294 INFO [Listener at localhost/42845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-18 10:01:16,294 INFO [Listener at localhost/42845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-18 10:01:16,295 INFO [Listener at localhost/42845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45923 2023-09-18 10:01:16,296 INFO [Listener at localhost/42845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-18 10:01:16,297 INFO [Listener at localhost/42845] mob.MobFileCache(124): MobFileCache disabled 2023-09-18 10:01:16,298 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,300 INFO [Listener at localhost/42845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,303 INFO [Listener at localhost/42845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45923 connecting to ZooKeeper ensemble=127.0.0.1:57492 2023-09-18 10:01:16,308 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:459230x0, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-18 10:01:16,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45923-0x100be7be17d0003 connected 2023-09-18 10:01:16,309 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-18 10:01:16,310 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:01:16,311 DEBUG [Listener at localhost/42845] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-18 10:01:16,312 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45923 2023-09-18 10:01:16,312 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45923 2023-09-18 10:01:16,312 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45923 2023-09-18 10:01:16,314 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45923 2023-09-18 10:01:16,317 DEBUG [Listener at localhost/42845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45923 2023-09-18 10:01:16,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:16,328 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-18 10:01:16,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:16,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-18 10:01:16,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-18 10:01:16,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-18 10:01:16,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-18 10:01:16,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:16,354 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-18 10:01:16,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34087,1695031274865 from backup master directory 2023-09-18 10:01:16,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-18 10:01:16,361 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:16,361 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-18 10:01:16,362 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-18 10:01:16,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:16,367 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-18 10:01:16,369 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-18 10:01:16,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/hbase.id with ID: 0b7a9cf0-86ef-4a21-95f0-0fd1f1d31902 2023-09-18 10:01:16,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-18 10:01:16,550 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:16,606 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2b2db392 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:16,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ffb8727, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:16,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-18 10:01:16,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-18 10:01:16,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-18 10:01:16,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-18 10:01:16,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-18 10:01:16,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-18 10:01:16,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-18 10:01:16,736 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store-tmp 2023-09-18 10:01:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-18 10:01:16,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:01:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:01:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-18 10:01:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:01:16,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:01:16,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-18 10:01:16,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/WALs/jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:16,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34087%2C1695031274865, suffix=, logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/WALs/jenkins-hbase4.apache.org,34087,1695031274865, archiveDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/oldWALs, maxLogs=10 2023-09-18 10:01:16,875 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK] 2023-09-18 10:01:16,875 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK] 2023-09-18 10:01:16,875 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK] 2023-09-18 10:01:16,886 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-18 10:01:16,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/WALs/jenkins-hbase4.apache.org,34087,1695031274865/jenkins-hbase4.apache.org%2C34087%2C1695031274865.1695031276822 2023-09-18 10:01:16,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK], DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK], DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK]] 2023-09-18 10:01:16,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-18 10:01:16,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:16,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-18 10:01:16,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-18 10:01:17,026 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-18 10:01:17,034 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-18 10:01:17,062 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-18 10:01:17,077 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:17,083 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-18 10:01:17,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-18 10:01:17,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-18 10:01:17,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:17,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62412399, jitterRate=-0.06998278200626373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:17,109 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-18 10:01:17,110 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-18 10:01:17,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-18 10:01:17,133 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-18 10:01:17,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-18 10:01:17,138 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-18 10:01:17,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-09-18 10:01:17,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-18 10:01:17,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-18 10:01:17,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-18 10:01:17,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-18 10:01:17,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-18 10:01:17,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-18 10:01:17,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-18 10:01:17,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-18 10:01:17,263 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:17,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-18 10:01:17,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-18 10:01:17,281 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-18 10:01:17,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-18 10:01:17,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-18 10:01:17,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,34087,1695031274865, sessionid=0x100be7be17d0000, setting cluster-up flag (Was=false) 2023-09-18 10:01:17,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-18 10:01:17,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-18 10:01:17,287 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:17,309 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:17,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-18 10:01:17,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:17,325 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:17,332 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-18 10:01:17,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:17,337 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp 2023-09-18 10:01:17,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-18 10:01:17,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:17,421 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(951): ClusterId : 0b7a9cf0-86ef-4a21-95f0-0fd1f1d31902 2023-09-18 10:01:17,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-18 10:01:17,422 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(951): ClusterId : 0b7a9cf0-86ef-4a21-95f0-0fd1f1d31902 2023-09-18 10:01:17,421 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(951): ClusterId : 0b7a9cf0-86ef-4a21-95f0-0fd1f1d31902 2023-09-18 10:01:17,428 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-18 10:01:17,428 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-18 10:01:17,428 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-18 10:01:17,435 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-18 10:01:17,435 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-18 10:01:17,435 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-18 10:01:17,436 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-18 10:01:17,435 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-18 10:01:17,436 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-18 10:01:17,441 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-18 10:01:17,441 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-18 10:01:17,441 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-18 10:01:17,446 DEBUG [RS:2;jenkins-hbase4:45923] zookeeper.ReadOnlyZKClient(139): Connect 0x1be1f3c3 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:17,446 DEBUG [RS:0;jenkins-hbase4:34469] zookeeper.ReadOnlyZKClient(139): Connect 0x747b59c8 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:17,446 DEBUG [RS:1;jenkins-hbase4:33575] zookeeper.ReadOnlyZKClient(139): Connect 0x62f1e446 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:17,456 DEBUG [RS:1;jenkins-hbase4:33575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c360668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:17,456 DEBUG [RS:2;jenkins-hbase4:45923] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15260ecf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:17,457 DEBUG [RS:1;jenkins-hbase4:33575] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68098f36, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-18 10:01:17,457 DEBUG [RS:2;jenkins-hbase4:45923] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@111998b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-18 10:01:17,492 DEBUG [RS:0;jenkins-hbase4:34469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7abca937, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:17,493 DEBUG [RS:0;jenkins-hbase4:34469] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b81a30c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-18 10:01:17,515 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34469 2023-09-18 10:01:17,517 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45923 2023-09-18 10:01:17,517 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33575 2023-09-18 10:01:17,522 INFO [RS:2;jenkins-hbase4:45923] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-18 10:01:17,522 INFO [RS:1;jenkins-hbase4:33575] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-18 10:01:17,523 INFO [RS:1;jenkins-hbase4:33575] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-18 10:01:17,522 INFO [RS:0;jenkins-hbase4:34469] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-18 10:01:17,523 INFO [RS:2;jenkins-hbase4:45923] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-18 10:01:17,523 INFO [RS:0;jenkins-hbase4:34469] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-18 10:01:17,523 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-18 10:01:17,523 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-18 10:01:17,523 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-18 10:01:17,524 INFO [RS:1;jenkins-hbase4:33575] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:17,525 INFO [RS:2;jenkins-hbase4:45923] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:17,525 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1022): About to register with Master. 2023-09-18 10:01:17,525 INFO [RS:0;jenkins-hbase4:34469] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:17,525 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1022): About to register with Master. 2023-09-18 10:01:17,525 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1022): About to register with Master. 2023-09-18 10:01:17,528 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34087,1695031274865 with isa=jenkins-hbase4.apache.org/172.31.14.131:33575, startcode=1695031276250 2023-09-18 10:01:17,528 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34087,1695031274865 with isa=jenkins-hbase4.apache.org/172.31.14.131:34469, startcode=1695031276191 2023-09-18 10:01:17,528 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,34087,1695031274865 with isa=jenkins-hbase4.apache.org/172.31.14.131:45923, startcode=1695031276292 2023-09-18 10:01:17,541 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-18 10:01:17,547 DEBUG [RS:1;jenkins-hbase4:33575] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-18 10:01:17,547 DEBUG [RS:0;jenkins-hbase4:34469] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-18 10:01:17,547 DEBUG [RS:2;jenkins-hbase4:45923] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-18 10:01:17,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-18 10:01:17,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-18 10:01:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-18 10:01:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-18 10:01:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-18 10:01:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-18 10:01:17,553 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695031307554 2023-09-18 10:01:17,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-18 10:01:17,562 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-18 10:01:17,563 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-18 10:01:17,569 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-18 10:01:17,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-18 10:01:17,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-18 10:01:17,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-18 10:01:17,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-18 10:01:17,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-18 10:01:17,586 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-18 10:01:17,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-18 10:01:17,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-18 10:01:17,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-18 10:01:17,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-18 10:01:17,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695031277596,5,FailOnTimeoutGroup] 2023-09-18 10:01:17,597 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695031277597,5,FailOnTimeoutGroup] 2023-09-18 10:01:17,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,597 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-18 10:01:17,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,610 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59967, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-18 10:01:17,610 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56961, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-18 10:01:17,610 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34435, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-18 10:01:17,633 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:17,634 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34087] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,634 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:17,635 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:17,649 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34087] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,650 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34087] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,663 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:17,663 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:17,663 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:17,663 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44901 2023-09-18 10:01:17,663 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-18 10:01:17,663 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44901 2023-09-18 10:01:17,663 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44901 2023-09-18 10:01:17,664 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-18 10:01:17,664 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-18 10:01:17,665 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:17,668 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-18 10:01:17,673 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/info 2023-09-18 10:01:17,673 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:01:17,674 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-18 10:01:17,674 DEBUG [RS:1;jenkins-hbase4:33575] zookeeper.ZKUtil(162): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,674 DEBUG [RS:2;jenkins-hbase4:45923] zookeeper.ZKUtil(162): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,675 DEBUG [RS:0;jenkins-hbase4:34469] zookeeper.ZKUtil(162): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,674 WARN [RS:1;jenkins-hbase4:33575] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-18 10:01:17,675 WARN [RS:0;jenkins-hbase4:34469] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-18 10:01:17,675 INFO [RS:1;jenkins-hbase4:33575] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-18 10:01:17,675 INFO [RS:0;jenkins-hbase4:34469] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-18 10:01:17,676 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,675 WARN [RS:2;jenkins-hbase4:45923] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-18 10:01:17,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:17,676 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,676 INFO [RS:2;jenkins-hbase4:45923] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-18 10:01:17,676 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-18 10:01:17,676 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,676 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45923,1695031276292] 2023-09-18 10:01:17,677 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34469,1695031276191] 2023-09-18 10:01:17,677 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33575,1695031276250] 2023-09-18 10:01:17,686 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/rep_barrier 2023-09-18 10:01:17,686 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-18 10:01:17,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:17,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-18 10:01:17,691 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/table 2023-09-18 10:01:17,692 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-18 10:01:17,693 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:17,698 DEBUG [RS:2;jenkins-hbase4:45923] zookeeper.ZKUtil(162): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,700 DEBUG [RS:1;jenkins-hbase4:33575] zookeeper.ZKUtil(162): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,700 DEBUG [RS:2;jenkins-hbase4:45923] zookeeper.ZKUtil(162): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,700 DEBUG [RS:0;jenkins-hbase4:34469] zookeeper.ZKUtil(162): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,700 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740 2023-09-18 10:01:17,701 DEBUG [RS:1;jenkins-hbase4:33575] zookeeper.ZKUtil(162): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,701 DEBUG [RS:0;jenkins-hbase4:34469] zookeeper.ZKUtil(162): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,701 DEBUG [RS:2;jenkins-hbase4:45923] zookeeper.ZKUtil(162): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,701 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740 2023-09-18 10:01:17,702 DEBUG [RS:0;jenkins-hbase4:34469] zookeeper.ZKUtil(162): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,702 DEBUG [RS:1;jenkins-hbase4:33575] zookeeper.ZKUtil(162): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,706 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-18 10:01:17,709 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-18 10:01:17,722 DEBUG [RS:2;jenkins-hbase4:45923] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-18 10:01:17,722 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-18 10:01:17,722 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-18 10:01:17,723 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:17,724 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66311559, jitterRate=-0.011880770325660706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-18 10:01:17,724 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-18 10:01:17,724 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-18 10:01:17,724 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-18 10:01:17,724 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-18 10:01:17,724 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-18 10:01:17,724 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-18 10:01:17,726 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-18 10:01:17,726 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-18 10:01:17,733 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-18 10:01:17,733 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-18 10:01:17,737 INFO [RS:1;jenkins-hbase4:33575] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-18 10:01:17,738 INFO [RS:2;jenkins-hbase4:45923] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-18 10:01:17,737 INFO [RS:0;jenkins-hbase4:34469] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-18 10:01:17,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-18 10:01:17,759 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-18 10:01:17,765 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-18 10:01:17,767 INFO [RS:1;jenkins-hbase4:33575] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-18 10:01:17,767 INFO [RS:2;jenkins-hbase4:45923] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-18 10:01:17,767 INFO [RS:0;jenkins-hbase4:34469] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-18 10:01:17,772 INFO [RS:1;jenkins-hbase4:33575] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-18 10:01:17,772 INFO [RS:2;jenkins-hbase4:45923] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-18 10:01:17,772 INFO [RS:0;jenkins-hbase4:34469] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-18 10:01:17,773 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,773 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,773 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,774 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-18 10:01:17,774 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-18 10:01:17,774 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-18 10:01:17,783 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,783 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,783 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,784 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,784 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-18 10:01:17,785 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-18 10:01:17,785 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-18 10:01:17,785 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,785 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,786 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,786 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,786 DEBUG [RS:1;jenkins-hbase4:33575] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,786 DEBUG [RS:0;jenkins-hbase4:34469] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,786 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,786 DEBUG [RS:2;jenkins-hbase4:45923] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-18 10:01:17,791 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,791 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,791 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,791 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,791 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,792 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,794 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,794 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,794 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,812 INFO [RS:2;jenkins-hbase4:45923] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-18 10:01:17,812 INFO [RS:0;jenkins-hbase4:34469] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-18 10:01:17,812 INFO [RS:1;jenkins-hbase4:33575] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-18 10:01:17,816 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33575,1695031276250-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,816 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34469,1695031276191-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,816 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45923,1695031276292-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:17,841 INFO [RS:1;jenkins-hbase4:33575] regionserver.Replication(203): jenkins-hbase4.apache.org,33575,1695031276250 started 2023-09-18 10:01:17,841 INFO [RS:2;jenkins-hbase4:45923] regionserver.Replication(203): jenkins-hbase4.apache.org,45923,1695031276292 started 2023-09-18 10:01:17,841 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33575,1695031276250, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33575, sessionid=0x100be7be17d0002 2023-09-18 10:01:17,841 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45923,1695031276292, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45923, sessionid=0x100be7be17d0003 2023-09-18 10:01:17,842 INFO [RS:0;jenkins-hbase4:34469] regionserver.Replication(203): jenkins-hbase4.apache.org,34469,1695031276191 started 2023-09-18 10:01:17,842 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34469,1695031276191, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34469, sessionid=0x100be7be17d0001 2023-09-18 10:01:17,842 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-18 10:01:17,842 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-18 10:01:17,842 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-18 10:01:17,842 DEBUG [RS:0;jenkins-hbase4:34469] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,843 DEBUG [RS:2;jenkins-hbase4:45923] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,843 DEBUG [RS:0;jenkins-hbase4:34469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34469,1695031276191' 2023-09-18 10:01:17,842 DEBUG [RS:1;jenkins-hbase4:33575] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,844 DEBUG [RS:1;jenkins-hbase4:33575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33575,1695031276250' 2023-09-18 10:01:17,844 DEBUG [RS:1;jenkins-hbase4:33575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-18 10:01:17,844 DEBUG [RS:0;jenkins-hbase4:34469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-18 10:01:17,843 DEBUG [RS:2;jenkins-hbase4:45923] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45923,1695031276292' 2023-09-18 10:01:17,844 DEBUG [RS:2;jenkins-hbase4:45923] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-18 10:01:17,845 DEBUG [RS:1;jenkins-hbase4:33575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-18 10:01:17,845 DEBUG [RS:0;jenkins-hbase4:34469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-18 10:01:17,845 DEBUG [RS:2;jenkins-hbase4:45923] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-18 10:01:17,845 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-18 10:01:17,845 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-18 10:01:17,845 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-18 10:01:17,845 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-18 10:01:17,846 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-18 10:01:17,846 DEBUG [RS:1;jenkins-hbase4:33575] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:17,846 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-18 10:01:17,847 DEBUG [RS:0;jenkins-hbase4:34469] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:17,847 DEBUG [RS:0;jenkins-hbase4:34469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34469,1695031276191' 2023-09-18 10:01:17,847 DEBUG [RS:0;jenkins-hbase4:34469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:17,846 DEBUG [RS:1;jenkins-hbase4:33575] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33575,1695031276250' 2023-09-18 10:01:17,846 DEBUG [RS:2;jenkins-hbase4:45923] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:17,847 DEBUG [RS:2;jenkins-hbase4:45923] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45923,1695031276292' 2023-09-18 10:01:17,847 DEBUG [RS:2;jenkins-hbase4:45923] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:17,847 DEBUG [RS:1;jenkins-hbase4:33575] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:17,847 DEBUG [RS:0;jenkins-hbase4:34469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:17,848 DEBUG [RS:2;jenkins-hbase4:45923] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:17,848 DEBUG [RS:1;jenkins-hbase4:33575] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:17,848 DEBUG [RS:0;jenkins-hbase4:34469] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-18 10:01:17,848 INFO [RS:0;jenkins-hbase4:34469] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-18 10:01:17,848 INFO [RS:0;jenkins-hbase4:34469] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-18 10:01:17,848 DEBUG [RS:2;jenkins-hbase4:45923] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-18 10:01:17,848 DEBUG [RS:1;jenkins-hbase4:33575] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-18 10:01:17,848 INFO [RS:2;jenkins-hbase4:45923] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-18 10:01:17,850 INFO [RS:1;jenkins-hbase4:33575] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-18 10:01:17,850 INFO [RS:1;jenkins-hbase4:33575] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-18 10:01:17,850 INFO [RS:2;jenkins-hbase4:45923] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-18 10:01:17,917 DEBUG [jenkins-hbase4:34087] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-18 10:01:17,922 DEBUG [jenkins-hbase4:34087] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:01:17,928 DEBUG [jenkins-hbase4:34087] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:01:17,928 DEBUG [jenkins-hbase4:34087] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:01:17,928 DEBUG [jenkins-hbase4:34087] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:01:17,928 DEBUG [jenkins-hbase4:34087] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:01:17,931 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33575,1695031276250, state=OPENING 2023-09-18 10:01:17,939 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-18 10:01:17,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:17,941 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-18 10:01:17,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:01:17,961 INFO [RS:0;jenkins-hbase4:34469] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34469%2C1695031276191, suffix=, logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,34469,1695031276191, archiveDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs, maxLogs=32 2023-09-18 10:01:17,961 INFO [RS:2;jenkins-hbase4:45923] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45923%2C1695031276292, suffix=, logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,45923,1695031276292, archiveDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs, maxLogs=32 2023-09-18 10:01:17,962 INFO [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33575%2C1695031276250, suffix=, logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,33575,1695031276250, archiveDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs, maxLogs=32 2023-09-18 10:01:17,986 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK] 2023-09-18 10:01:17,987 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK] 2023-09-18 10:01:17,993 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK] 2023-09-18 10:01:18,007 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK] 2023-09-18 10:01:18,007 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK] 2023-09-18 10:01:18,007 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK] 2023-09-18 10:01:18,010 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK] 2023-09-18 10:01:18,010 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK] 2023-09-18 10:01:18,011 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK] 2023-09-18 10:01:18,011 INFO [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,33575,1695031276250/jenkins-hbase4.apache.org%2C33575%2C1695031276250.1695031277966 2023-09-18 10:01:18,018 DEBUG [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK], DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK], DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK]] 2023-09-18 10:01:18,024 INFO [RS:2;jenkins-hbase4:45923] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,45923,1695031276292/jenkins-hbase4.apache.org%2C45923%2C1695031276292.1695031277966 2023-09-18 10:01:18,024 INFO [RS:0;jenkins-hbase4:34469] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,34469,1695031276191/jenkins-hbase4.apache.org%2C34469%2C1695031276191.1695031277966 2023-09-18 10:01:18,025 DEBUG [RS:2;jenkins-hbase4:45923] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK], DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK], DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK]] 2023-09-18 10:01:18,028 DEBUG [RS:0;jenkins-hbase4:34469] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK], DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK], DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK]] 2023-09-18 10:01:18,134 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:18,137 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-18 10:01:18,141 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-18 10:01:18,156 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-18 10:01:18,156 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-18 10:01:18,160 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33575%2C1695031276250.meta, suffix=.meta, logDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,33575,1695031276250, archiveDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs, maxLogs=32 2023-09-18 10:01:18,183 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK] 2023-09-18 10:01:18,184 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK] 2023-09-18 10:01:18,183 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK] 2023-09-18 10:01:18,192 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/WALs/jenkins-hbase4.apache.org,33575,1695031276250/jenkins-hbase4.apache.org%2C33575%2C1695031276250.meta.1695031278161.meta 2023-09-18 10:01:18,192 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46027,DS-f76cc108-81e0-4260-83ff-6b5e216067e2,DISK], DatanodeInfoWithStorage[127.0.0.1:44477,DS-fb0c3d73-206b-48cb-a1d3-9f2f05535485,DISK], DatanodeInfoWithStorage[127.0.0.1:43295,DS-19aa0c69-d1c7-4ebe-a3fe-10d66acc42a2,DISK]] 2023-09-18 10:01:18,193 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-18 10:01:18,194 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-18 10:01:18,195 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:18,196 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-18 10:01:18,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-18 10:01:18,200 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-18 10:01:18,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-18 10:01:18,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:18,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-18 10:01:18,215 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-18 10:01:18,218 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-18 10:01:18,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/info 2023-09-18 10:01:18,220 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/info 2023-09-18 10:01:18,221 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-18 10:01:18,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:18,222 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-18 10:01:18,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/rep_barrier 2023-09-18 10:01:18,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/rep_barrier 2023-09-18 10:01:18,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-18 10:01:18,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:18,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-18 10:01:18,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/table 2023-09-18 10:01:18,226 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/table 2023-09-18 10:01:18,227 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-18 10:01:18,228 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:18,230 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740 2023-09-18 10:01:18,233 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740 2023-09-18 10:01:18,236 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-18 10:01:18,239 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-18 10:01:18,240 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72520736, jitterRate=0.0806431770324707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-18 10:01:18,244 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-18 10:01:18,259 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695031278126 2023-09-18 10:01:18,280 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-18 10:01:18,280 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-18 10:01:18,281 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33575,1695031276250, state=OPEN 2023-09-18 10:01:18,284 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-18 10:01:18,284 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-18 10:01:18,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-18 10:01:18,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33575,1695031276250 in 339 msec 2023-09-18 10:01:18,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-18 10:01:18,293 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 545 msec 2023-09-18 10:01:18,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 866 msec 2023-09-18 10:01:18,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695031278300, completionTime=-1 2023-09-18 10:01:18,300 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-18 10:01:18,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-18 10:01:18,372 DEBUG [hconnection-0x614d5738-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:18,376 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-18 10:01:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695031338397 2023-09-18 10:01:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695031398397 2023-09-18 10:01:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 97 msec 2023-09-18 10:01:18,421 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34087,1695031274865-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:18,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34087,1695031274865-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:18,422 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34087,1695031274865-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:18,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34087, period=300000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:18,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-18 10:01:18,435 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-18 10:01:18,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-18 10:01:18,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-18 10:01:18,459 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-18 10:01:18,463 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:01:18,466 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:01:18,493 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/namespace/083ae49f63cd23321343d618bec16700 2023-09-18 10:01:18,496 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/namespace/083ae49f63cd23321343d618bec16700 empty. 2023-09-18 10:01:18,497 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/namespace/083ae49f63cd23321343d618bec16700 2023-09-18 10:01:18,497 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-18 10:01:18,555 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:18,557 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 083ae49f63cd23321343d618bec16700, NAME => 'hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:18,582 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:18,583 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 083ae49f63cd23321343d618bec16700, disabling compactions & flushes 2023-09-18 10:01:18,583 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:18,583 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:18,583 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. after waiting 0 ms 2023-09-18 10:01:18,583 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:18,583 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:18,583 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 083ae49f63cd23321343d618bec16700: 2023-09-18 10:01:18,587 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:01:18,604 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695031278591"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031278591"}]},"ts":"1695031278591"} 2023-09-18 10:01:18,685 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-18 10:01:18,687 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:01:18,691 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031278687"}]},"ts":"1695031278687"} 2023-09-18 10:01:18,697 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-18 10:01:18,701 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:01:18,702 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:01:18,702 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:01:18,702 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:01:18,702 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:01:18,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=083ae49f63cd23321343d618bec16700, ASSIGN}] 2023-09-18 10:01:18,708 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=083ae49f63cd23321343d618bec16700, ASSIGN 2023-09-18 10:01:18,710 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=083ae49f63cd23321343d618bec16700, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33575,1695031276250; forceNewPlan=false, retain=false 2023-09-18 10:01:18,862 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-18 10:01:18,863 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=083ae49f63cd23321343d618bec16700, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:18,864 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695031278863"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031278863"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031278863"}]},"ts":"1695031278863"} 2023-09-18 10:01:18,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 083ae49f63cd23321343d618bec16700, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:01:19,033 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:19,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 083ae49f63cd23321343d618bec16700, NAME => 'hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.', STARTKEY => '', ENDKEY => ''} 2023-09-18 10:01:19,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. service=AccessControlService 2023-09-18 10:01:19,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:19,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:19,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,035 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,038 INFO [StoreOpener-083ae49f63cd23321343d618bec16700-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,040 DEBUG [StoreOpener-083ae49f63cd23321343d618bec16700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/info 2023-09-18 10:01:19,040 DEBUG [StoreOpener-083ae49f63cd23321343d618bec16700-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/info 2023-09-18 10:01:19,041 INFO [StoreOpener-083ae49f63cd23321343d618bec16700-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 083ae49f63cd23321343d618bec16700 columnFamilyName info 2023-09-18 10:01:19,042 INFO [StoreOpener-083ae49f63cd23321343d618bec16700-1] regionserver.HStore(310): Store=083ae49f63cd23321343d618bec16700/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:19,044 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,045 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,049 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 083ae49f63cd23321343d618bec16700 2023-09-18 10:01:19,053 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:19,054 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 083ae49f63cd23321343d618bec16700; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68284455, jitterRate=0.01751767098903656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:19,054 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 083ae49f63cd23321343d618bec16700: 2023-09-18 10:01:19,056 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700., pid=6, masterSystemTime=1695031279024 2023-09-18 10:01:19,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:19,060 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:01:19,061 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=083ae49f63cd23321343d618bec16700, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:19,062 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695031279061"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031279061"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031279061"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031279061"}]},"ts":"1695031279061"} 2023-09-18 10:01:19,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-18 10:01:19,069 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 083ae49f63cd23321343d618bec16700, server=jenkins-hbase4.apache.org,33575,1695031276250 in 196 msec 2023-09-18 10:01:19,073 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-18 10:01:19,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=083ae49f63cd23321343d618bec16700, ASSIGN in 364 msec 2023-09-18 10:01:19,075 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:01:19,076 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031279076"}]},"ts":"1695031279076"} 2023-09-18 10:01:19,078 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-18 10:01:19,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:01:19,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 633 msec 2023-09-18 10:01:19,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-18 10:01:19,164 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-18 10:01:19,164 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:19,198 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-18 10:01:19,214 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-18 10:01:19,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-09-18 10:01:19,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-18 10:01:19,246 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-18 10:01:19,251 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-09-18 10:01:19,258 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-18 10:01:19,261 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-18 10:01:19,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.899sec 2023-09-18 10:01:19,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-18 10:01:19,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-18 10:01:19,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-18 10:01:19,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34087,1695031274865-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-18 10:01:19,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34087,1695031274865-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-18 10:01:19,289 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-18 10:01:19,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-18 10:01:19,293 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:01:19,295 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:01:19,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-18 10:01:19,297 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,298 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf empty. 2023-09-18 10:01:19,302 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-18 10:01:19,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-18 10:01:19,327 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:19,329 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9d4929b98c755e66e6710ea7841b0caf, NAME => 'hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:19,351 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:19,351 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 9d4929b98c755e66e6710ea7841b0caf, disabling compactions & flushes 2023-09-18 10:01:19,351 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,351 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,351 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. after waiting 0 ms 2023-09-18 10:01:19,351 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,351 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,352 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 9d4929b98c755e66e6710ea7841b0caf: 2023-09-18 10:01:19,357 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:01:19,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695031279358"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031279358"}]},"ts":"1695031279358"} 2023-09-18 10:01:19,360 DEBUG [Listener at localhost/42845] zookeeper.ReadOnlyZKClient(139): Connect 0x5773f6d0 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:19,363 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-18 10:01:19,365 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:01:19,365 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031279365"}]},"ts":"1695031279365"} 2023-09-18 10:01:19,365 DEBUG [Listener at localhost/42845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a20d86f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:19,368 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-18 10:01:19,377 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:01:19,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:01:19,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:01:19,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:01:19,378 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:01:19,378 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9d4929b98c755e66e6710ea7841b0caf, ASSIGN}] 2023-09-18 10:01:19,383 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=9d4929b98c755e66e6710ea7841b0caf, ASSIGN 2023-09-18 10:01:19,384 DEBUG [hconnection-0x2d83dbed-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:19,385 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=9d4929b98c755e66e6710ea7841b0caf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34469,1695031276191; forceNewPlan=false, retain=false 2023-09-18 10:01:19,398 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53832, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:19,401 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:01:19,401 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-18 10:01:19,401 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/test.cache.data in system properties and HBase conf 2023-09-18 10:01:19,401 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop.tmp.dir in system properties and HBase conf 2023-09-18 10:01:19,401 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop.log.dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/nfs.dump.dir in system properties and HBase conf 2023-09-18 10:01:19,402 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir in system properties and HBase conf 2023-09-18 10:01:19,403 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-18 10:01:19,403 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-18 10:01:19,403 INFO [Listener at localhost/42845] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-18 10:01:19,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-18 10:01:19,535 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-18 10:01:19,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9d4929b98c755e66e6710ea7841b0caf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:19,537 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695031279536"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031279536"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031279536"}]},"ts":"1695031279536"} 2023-09-18 10:01:19,540 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 9d4929b98c755e66e6710ea7841b0caf, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:01:19,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-18 10:01:19,695 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:19,695 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-18 10:01:19,699 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-18 10:01:19,706 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9d4929b98c755e66e6710ea7841b0caf, NAME => 'hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.', STARTKEY => '', ENDKEY => ''} 2023-09-18 10:01:19,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. service=AccessControlService 2023-09-18 10:01:19,707 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:19,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:19,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,710 INFO [StoreOpener-9d4929b98c755e66e6710ea7841b0caf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,713 DEBUG [StoreOpener-9d4929b98c755e66e6710ea7841b0caf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/l 2023-09-18 10:01:19,713 DEBUG [StoreOpener-9d4929b98c755e66e6710ea7841b0caf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/l 2023-09-18 10:01:19,713 INFO [StoreOpener-9d4929b98c755e66e6710ea7841b0caf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9d4929b98c755e66e6710ea7841b0caf columnFamilyName l 2023-09-18 10:01:19,715 INFO [StoreOpener-9d4929b98c755e66e6710ea7841b0caf-1] regionserver.HStore(310): Store=9d4929b98c755e66e6710ea7841b0caf/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:19,717 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,718 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:01:19,728 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:19,729 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9d4929b98c755e66e6710ea7841b0caf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62832363, jitterRate=-0.0637248307466507}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:19,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9d4929b98c755e66e6710ea7841b0caf: 2023-09-18 10:01:19,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf., pid=11, masterSystemTime=1695031279695 2023-09-18 10:01:19,736 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,737 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:01:19,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=9d4929b98c755e66e6710ea7841b0caf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:19,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695031279738"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031279738"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031279738"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031279738"}]},"ts":"1695031279738"} 2023-09-18 10:01:19,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-18 10:01:19,745 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 9d4929b98c755e66e6710ea7841b0caf, server=jenkins-hbase4.apache.org,34469,1695031276191 in 201 msec 2023-09-18 10:01:19,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-18 10:01:19,749 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=9d4929b98c755e66e6710ea7841b0caf, ASSIGN in 367 msec 2023-09-18 10:01:19,750 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:01:19,750 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031279750"}]},"ts":"1695031279750"} 2023-09-18 10:01:19,753 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-18 10:01:19,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:01:19,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 467 msec 2023-09-18 10:01:19,912 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-18 10:01:19,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-18 10:01:19,924 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-18 10:01:20,588 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:20,950 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:20,960 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41421_jobhistory____.7kkbr5/webapp 2023-09-18 10:01:21,157 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-18 10:01:21,158 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-18 10:01:21,158 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-18 10:01:21,161 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-18 10:01:21,252 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:21,576 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:21,890 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-18 10:01:21,923 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41421 2023-09-18 10:01:22,081 WARN [Listener at jenkins-hbase4.apache.org/35417] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:22,364 WARN [Listener at jenkins-hbase4.apache.org/35417] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-18 10:01:22,365 INFO [Listener at jenkins-hbase4.apache.org/35417] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:22,372 INFO [Listener at jenkins-hbase4.apache.org/35417] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43903_cluster____.r7dh21/webapp 2023-09-18 10:01:22,442 INFO [Listener at jenkins-hbase4.apache.org/35417] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-18 10:01:22,443 INFO [Listener at jenkins-hbase4.apache.org/35417] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-18 10:01:22,443 INFO [Listener at jenkins-hbase4.apache.org/35417] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-18 10:01:22,443 INFO [Listener at jenkins-hbase4.apache.org/35417] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-18 10:01:22,452 INFO [Listener at jenkins-hbase4.apache.org/35417] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:22,645 INFO [Listener at jenkins-hbase4.apache.org/35417] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:22,726 INFO [Listener at jenkins-hbase4.apache.org/35417] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:22,738 INFO [Listener at jenkins-hbase4.apache.org/35417] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43903 2023-09-18 10:01:23,294 WARN [Listener at jenkins-hbase4.apache.org/40033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:23,320 WARN [Listener at jenkins-hbase4.apache.org/40033] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-18 10:01:23,321 INFO [Listener at jenkins-hbase4.apache.org/40033] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:23,328 INFO [Listener at jenkins-hbase4.apache.org/40033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33895_node____.3750b2/webapp 2023-09-18 10:01:23,381 INFO [Listener at jenkins-hbase4.apache.org/40033] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-18 10:01:23,381 INFO [Listener at jenkins-hbase4.apache.org/40033] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-18 10:01:23,381 INFO [Listener at jenkins-hbase4.apache.org/40033] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-18 10:01:23,381 INFO [Listener at jenkins-hbase4.apache.org/40033] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-18 10:01:23,389 INFO [Listener at jenkins-hbase4.apache.org/40033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:23,410 INFO [Listener at jenkins-hbase4.apache.org/40033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:23,482 INFO [Listener at jenkins-hbase4.apache.org/40033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:23,496 INFO [Listener at jenkins-hbase4.apache.org/40033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33895 2023-09-18 10:01:23,652 WARN [Listener at jenkins-hbase4.apache.org/40259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-18 10:01:23,658 WARN [Listener at jenkins-hbase4.apache.org/40259] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-18 10:01:23,658 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): jetty-6.1.26 2023-09-18 10:01:23,665 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43663_node____.l540fi/webapp 2023-09-18 10:01:23,716 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-18 10:01:23,716 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-18 10:01:23,716 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-18 10:01:23,716 INFO [Listener at jenkins-hbase4.apache.org/40259] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-18 10:01:23,724 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:23,737 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:23,774 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:01:23,834 INFO [Listener at jenkins-hbase4.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-18 10:01:23,845 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43663 2023-09-18 10:01:23,880 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-18 10:01:23,882 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:23,953 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=101, ProcessCount=164, AvailableMemoryMB=9163 2023-09-18 10:01:23,953 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-09-18 10:01:23,975 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-18 10:01:23,984 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-18 10:01:23,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-18 10:01:23,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:24,000 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:01:24,001 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-18 10:01:24,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-18 10:01:24,003 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-18 10:01:24,003 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:01:24,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-18 10:01:24,004 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-18 10:01:24,008 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,008 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,012 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a empty. 2023-09-18 10:01:24,012 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 empty. 2023-09-18 10:01:24,014 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,014 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,014 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-18 10:01:24,045 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:24,047 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2907a96d58017ebaa8b09d1b4a52fbc7, NAME => 'testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:24,047 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3898f4b07560e1560743c8d3dcf7512a, NAME => 'testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:24,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:24,088 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 3898f4b07560e1560743c8d3dcf7512a, disabling compactions & flushes 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2907a96d58017ebaa8b09d1b4a52fbc7, disabling compactions & flushes 2023-09-18 10:01:24,089 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,089 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. after waiting 0 ms 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. after waiting 0 ms 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,089 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,089 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,089 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2907a96d58017ebaa8b09d1b4a52fbc7: 2023-09-18 10:01:24,090 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 3898f4b07560e1560743c8d3dcf7512a: 2023-09-18 10:01:24,094 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:01:24,095 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031284095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031284095"}]},"ts":"1695031284095"} 2023-09-18 10:01:24,095 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031284095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031284095"}]},"ts":"1695031284095"} 2023-09-18 10:01:24,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-18 10:01:24,144 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:01:24,146 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:01:24,146 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031284146"}]},"ts":"1695031284146"} 2023-09-18 10:01:24,148 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-18 10:01:24,163 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:01:24,165 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:01:24,165 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:01:24,165 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:01:24,165 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:01:24,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, ASSIGN}] 2023-09-18 10:01:24,169 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, ASSIGN 2023-09-18 10:01:24,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, ASSIGN 2023-09-18 10:01:24,170 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:01:24,171 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33575,1695031276250; forceNewPlan=false, retain=false 2023-09-18 10:01:24,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-18 10:01:24,321 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:01:24,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2907a96d58017ebaa8b09d1b4a52fbc7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:24,323 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3898f4b07560e1560743c8d3dcf7512a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:24,324 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031284323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031284323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031284323"}]},"ts":"1695031284323"} 2023-09-18 10:01:24,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031284323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031284323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031284323"}]},"ts":"1695031284323"} 2023-09-18 10:01:24,326 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 2907a96d58017ebaa8b09d1b4a52fbc7, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:01:24,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 3898f4b07560e1560743c8d3dcf7512a, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:01:24,481 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:24,481 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-18 10:01:24,485 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-18 10:01:24,493 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3898f4b07560e1560743c8d3dcf7512a, NAME => 'testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.', STARTKEY => '', ENDKEY => '1'} 2023-09-18 10:01:24,493 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. service=AccessControlService 2023-09-18 10:01:24,494 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:24,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:24,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2907a96d58017ebaa8b09d1b4a52fbc7, NAME => 'testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.', STARTKEY => '1', ENDKEY => ''} 2023-09-18 10:01:24,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. service=AccessControlService 2023-09-18 10:01:24,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:24,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:24,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,501 INFO [StoreOpener-2907a96d58017ebaa8b09d1b4a52fbc7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,501 INFO [StoreOpener-3898f4b07560e1560743c8d3dcf7512a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,503 DEBUG [StoreOpener-3898f4b07560e1560743c8d3dcf7512a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf 2023-09-18 10:01:24,503 DEBUG [StoreOpener-3898f4b07560e1560743c8d3dcf7512a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf 2023-09-18 10:01:24,503 DEBUG [StoreOpener-2907a96d58017ebaa8b09d1b4a52fbc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf 2023-09-18 10:01:24,503 DEBUG [StoreOpener-2907a96d58017ebaa8b09d1b4a52fbc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf 2023-09-18 10:01:24,508 INFO [StoreOpener-2907a96d58017ebaa8b09d1b4a52fbc7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2907a96d58017ebaa8b09d1b4a52fbc7 columnFamilyName cf 2023-09-18 10:01:24,508 INFO [StoreOpener-3898f4b07560e1560743c8d3dcf7512a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3898f4b07560e1560743c8d3dcf7512a columnFamilyName cf 2023-09-18 10:01:24,512 INFO [StoreOpener-3898f4b07560e1560743c8d3dcf7512a-1] regionserver.HStore(310): Store=3898f4b07560e1560743c8d3dcf7512a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:24,512 INFO [StoreOpener-2907a96d58017ebaa8b09d1b4a52fbc7-1] regionserver.HStore(310): Store=2907a96d58017ebaa8b09d1b4a52fbc7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:24,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:24,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:24,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:24,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:24,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3898f4b07560e1560743c8d3dcf7512a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61992569, jitterRate=-0.0762387365102768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:24,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3898f4b07560e1560743c8d3dcf7512a: 2023-09-18 10:01:24,532 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2907a96d58017ebaa8b09d1b4a52fbc7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61392627, jitterRate=-0.08517856895923615}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:24,532 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2907a96d58017ebaa8b09d1b4a52fbc7: 2023-09-18 10:01:24,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a., pid=16, masterSystemTime=1695031284481 2023-09-18 10:01:24,534 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7., pid=15, masterSystemTime=1695031284481 2023-09-18 10:01:24,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:24,541 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3898f4b07560e1560743c8d3dcf7512a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:24,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:24,542 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031284541"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031284541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031284541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031284541"}]},"ts":"1695031284541"} 2023-09-18 10:01:24,543 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2907a96d58017ebaa8b09d1b4a52fbc7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:24,543 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031284543"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031284543"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031284543"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031284543"}]},"ts":"1695031284543"} 2023-09-18 10:01:24,549 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-18 10:01:24,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 3898f4b07560e1560743c8d3dcf7512a, server=jenkins-hbase4.apache.org,33575,1695031276250 in 218 msec 2023-09-18 10:01:24,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-18 10:01:24,552 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 2907a96d58017ebaa8b09d1b4a52fbc7, server=jenkins-hbase4.apache.org,45923,1695031276292 in 222 msec 2023-09-18 10:01:24,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, ASSIGN in 384 msec 2023-09-18 10:01:24,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-18 10:01:24,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, ASSIGN in 386 msec 2023-09-18 10:01:24,556 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:01:24,557 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031284556"}]},"ts":"1695031284556"} 2023-09-18 10:01:24,558 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-18 10:01:24,561 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:01:24,566 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-18 10:01:24,572 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:24,575 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:24,581 DEBUG [hconnection-0x43dd22ef-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:24,584 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-18 10:01:24,593 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-18 10:01:24,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-18 10:01:24,626 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:24,626 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:24,626 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:01:24,626 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:24,626 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:24,634 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:24,634 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:24,634 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:24,634 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:24,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:24,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:24,635 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:24,637 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 641 msec 2023-09-18 10:01:25,053 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:25,054 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-18 10:01:25,054 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:25,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-18 10:01:25,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-18 10:01:25,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-18 10:01:25,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:25,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-18 10:01:25,055 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-18 10:01:25,055 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-18 10:01:25,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-18 10:01:25,110 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-18 10:01:25,115 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-18 10:01:25,116 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:25,119 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:25,147 DEBUG [hconnection-0x2d83dbed-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,152 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-18 10:01:25,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031285166 (current time:1695031285166). 2023-09-18 10:01:25,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:01:25,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x0816b9e9 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:25,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a371710, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:25,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,179 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0816b9e9 to 127.0.0.1:57492 2023-09-18 10:01:25,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:25,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x30d9164f to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:25,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2532143e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:25,197 DEBUG [hconnection-0x3b876a35-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,198 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,203 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d9164f to 127.0.0.1:57492 2023-09-18 10:01:25,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:25,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-18 10:01:25,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:01:25,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-18 10:01:25,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-18 10:01:25,253 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-18 10:01:25,254 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695031885254 2023-09-18 10:01:25,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-18 10:01:25,254 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-18 10:01:25,257 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-18 10:01:25,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-18 10:01:25,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-18 10:01:25,260 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-18 10:01:25,261 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695031885261 2023-09-18 10:01:25,262 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:01:25,262 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:01:25,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,287 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-18 10:01:25,287 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,287 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-18 10:01:25,287 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-18 10:01:25,288 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,288 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,295 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,295 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,295 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,295 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,296 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,296 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,296 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,297 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-18 10:01:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-18 10:01:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-18 10:01:25,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-18 10:01:25,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-18 10:01:25,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,301 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,305 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-18 10:01:25,305 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-18 10:01:25,305 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,305 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,305 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-18 10:01:25,306 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-18 10:01:25,306 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-18 10:01:25,305 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-18 10:01:25,306 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-18 10:01:25,306 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,306 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-18 10:01:25,307 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-18 10:01:25,307 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-18 10:01:25,307 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-18 10:01:25,307 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-18 10:01:25,309 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,309 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,310 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,310 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,310 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,311 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,311 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:25,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,311 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,311 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:25,311 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,311 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:25,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-18 10:01:25,314 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 1] remaining members to acquire global barrier 2023-09-18 10:01:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-18 10:01:25,317 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51de22b0[Count = 0] remaining members to acquire global barrier 2023-09-18 10:01:25,317 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-18 10:01:25,317 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,320 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,320 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,320 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,321 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-18 10:01:25,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,321 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-18 10:01:25,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,321 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:01:25,321 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-18 10:01:25,321 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,321 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-18 10:01:25,322 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,322 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:01:25,326 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:25,327 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:25,327 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:25,327 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:25,327 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:25,327 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-18 10:01:25,327 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:25,327 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:25,327 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-18 10:01:25,328 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. started... 2023-09-18 10:01:25,328 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. started... 2023-09-18 10:01:25,332 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2907a96d58017ebaa8b09d1b4a52fbc7: 2023-09-18 10:01:25,332 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3898f4b07560e1560743c8d3dcf7512a: 2023-09-18 10:01:25,333 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,333 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:25,341 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:25,346 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:01:25,346 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:01:25,362 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:25,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-18 10:01:25,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:25,374 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:01:25,376 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. completed. 2023-09-18 10:01:25,377 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:25,377 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:25,377 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:25,377 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,377 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-18 10:01:25,377 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:01:25,380 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,380 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-18 10:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,380 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,380 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-18 10:01:25,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,382 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. completed. 2023-09-18 10:01:25,382 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-18 10:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:01:25,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,386 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-18 10:01:25,385 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,386 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:25,386 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-18 10:01:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33575,1695031276250': 2023-09-18 10:01:25,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-18 10:01:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:01:25,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-18 10:01:25,396 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-18 10:01:25,396 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:01:25,396 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:01:25,396 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,396 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:01:25,400 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:25,400 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,401 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:25,400 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,401 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:25,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:25,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:25,402 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,402 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,404 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,405 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,406 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,419 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,419 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,419 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,419 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,420 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,420 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:25,419 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,420 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:25,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,420 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:25,420 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:25,420 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,420 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-18 10:01:25,421 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:01:25,421 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,421 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,421 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,421 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:25,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:25,421 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:25,422 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:25,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:25,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-18 10:01:25,439 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,442 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-18 10:01:25,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,496 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:25,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695031285255Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695031285439 (+184 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695031285439Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695031285440 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695031285453 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695031285482 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695031285495 (+13 ms) 2023-09-18 10:01:25,499 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-18 10:01:25,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 243 msec 2023-09-18 10:01:25,574 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:25,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-18 10:01:25,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:01:25,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33575] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:01:25,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:01:25,608 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-18 10:01:25,608 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:25,608 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:25,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-18 10:01:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031285625 (current time:1695031285625). 2023-09-18 10:01:25,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:01:25,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x1def083b to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:25,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ce98944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:25,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,636 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1def083b to 127.0.0.1:57492 2023-09-18 10:01:25,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:25,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x534e004a to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:25,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@368564c8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:25,647 DEBUG [hconnection-0x66f678f5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,649 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:25,655 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534e004a to 127.0.0.1:57492 2023-09-18 10:01:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-18 10:01:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:01:25,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-18 10:01:25,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-18 10:01:25,662 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-18 10:01:25,663 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695031885663 2023-09-18 10:01:25,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-18 10:01:25,663 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-18 10:01:25,665 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:01:25,665 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:01:25,666 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-18 10:01:25,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-18 10:01:25,668 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-18 10:01:25,669 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-18 10:01:25,670 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695031885670 2023-09-18 10:01:25,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-18 10:01:25,686 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-18 10:01:25,686 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,687 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-18 10:01:25,687 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-18 10:01:25,687 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,687 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,689 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,689 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,689 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,689 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:25,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:25,690 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,690 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,690 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,690 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:01:25,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-18 10:01:25,691 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-18 10:01:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-18 10:01:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,691 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-18 10:01:25,692 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-18 10:01:25,692 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-18 10:01:25,692 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,692 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-18 10:01:25,693 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-18 10:01:25,693 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-18 10:01:25,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-18 10:01:25,693 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-18 10:01:25,694 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-18 10:01:25,694 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:25,694 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-18 10:01:25,694 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-18 10:01:25,694 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-18 10:01:25,696 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,696 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,698 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:25,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:25,698 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:25,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-18 10:01:25,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 1] remaining members to acquire global barrier 2023-09-18 10:01:25,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:25,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-18 10:01:25,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@385cba3d[Count = 0] remaining members to acquire global barrier 2023-09-18 10:01:25,704 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-18 10:01:25,705 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,708 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,708 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,708 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,709 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:25,709 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:25,709 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:25,709 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,710 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:01:25,709 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:25,710 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:25,709 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. started... 2023-09-18 10:01:25,709 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. started... 2023-09-18 10:01:25,710 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3898f4b07560e1560743c8d3dcf7512a 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-18 10:01:25,710 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2907a96d58017ebaa8b09d1b4a52fbc7 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-18 10:01:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-18 10:01:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:25,712 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-18 10:01:25,765 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:25,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-18 10:01:25,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:25,767 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:01:25,850 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091815eac411f0474c1da27afa780ae2526e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091815eac411f0474c1da27afa780ae2526e 2023-09-18 10:01:25,850 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230918c082fde7a9174b87a2bb9d097f667ca5 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230918c082fde7a9174b87a2bb9d097f667ca5 2023-09-18 10:01:25,886 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/.tmp/cf/138030edc7b34498a87d11cf4b231f4c 2023-09-18 10:01:25,887 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/.tmp/cf/ba1d646fd99e48b8bf0bffa157d55b95 2023-09-18 10:01:25,898 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/.tmp/cf/138030edc7b34498a87d11cf4b231f4c as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf/138030edc7b34498a87d11cf4b231f4c 2023-09-18 10:01:25,898 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/.tmp/cf/ba1d646fd99e48b8bf0bffa157d55b95 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf/ba1d646fd99e48b8bf0bffa157d55b95 2023-09-18 10:01:25,907 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf/138030edc7b34498a87d11cf4b231f4c, entries=46, sequenceid=6, filesize=12.6 K 2023-09-18 10:01:25,908 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf/ba1d646fd99e48b8bf0bffa157d55b95, entries=4, sequenceid=6, filesize=5.6 K 2023-09-18 10:01:25,912 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2907a96d58017ebaa8b09d1b4a52fbc7 in 202ms, sequenceid=6, compaction requested=false 2023-09-18 10:01:25,912 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 3898f4b07560e1560743c8d3dcf7512a in 202ms, sequenceid=6, compaction requested=false 2023-09-18 10:01:25,912 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-18 10:01:25,912 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-18 10:01:25,914 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3898f4b07560e1560743c8d3dcf7512a: 2023-09-18 10:01:25,914 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2907a96d58017ebaa8b09d1b4a52fbc7: 2023-09-18 10:01:25,914 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-18 10:01:25,914 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-18 10:01:25,915 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:25,915 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:25,915 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf/ba1d646fd99e48b8bf0bffa157d55b95] hfiles 2023-09-18 10:01:25,915 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf/138030edc7b34498a87d11cf4b231f4c] hfiles 2023-09-18 10:01:25,915 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf/ba1d646fd99e48b8bf0bffa157d55b95 for snapshot=snaptb0-testExportWithTargetName 2023-09-18 10:01:25,915 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf/138030edc7b34498a87d11cf4b231f4c for snapshot=snaptb0-testExportWithTargetName 2023-09-18 10:01:25,941 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. completed. 2023-09-18 10:01:25,941 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:25,941 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:25,941 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:25,941 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,941 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-18 10:01:25,941 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:01:25,943 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,943 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-18 10:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:25,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:25,943 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:25,944 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-18 10:01:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:25,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:25,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:25,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:25,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:01:25,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-18 10:01:25,967 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:25,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-18 10:01:25,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:25,969 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-18 10:01:26,269 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:26,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-18 10:01:26,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:26,271 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-18 10:01:26,339 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. completed. 2023-09-18 10:01:26,339 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:26,339 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:26,339 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:26,340 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,340 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-18 10:01:26,340 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:01:26,341 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,341 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-18 10:01:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:26,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:26,341 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:26,342 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-18 10:01:26,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:26,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33575,1695031276250': 2023-09-18 10:01:26,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-18 10:01:26,349 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-18 10:01:26,349 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:01:26,349 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:01:26,349 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-18 10:01:26,349 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:01:26,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:26,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:26,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:26,353 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,353 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:26,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:26,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:26,354 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,354 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:26,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:26,357 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-18 10:01:26,358 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,358 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:26,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:26,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:26,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,369 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:26,369 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-18 10:01:26,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-18 10:01:26,370 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:26,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:26,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-18 10:01:26,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:26,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,369 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:26,370 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:01:26,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:26,371 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:26,371 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,371 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:26,371 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:26,371 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,371 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:26,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:26,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:26,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:26,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230918c082fde7a9174b87a2bb9d097f667ca5, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091815eac411f0474c1da27afa780ae2526e] mob files 2023-09-18 10:01:26,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230918c082fde7a9174b87a2bb9d097f667ca5 2023-09-18 10:01:26,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091815eac411f0474c1da27afa780ae2526e 2023-09-18 10:01:26,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-18 10:01:26,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,429 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,430 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-18 10:01:26,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,430 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-18 10:01:26,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695031285663Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695031286390 (+727 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695031286390Loading Region manifests for snaptb0-testExportWithTargetName at 1695031286390Writing data manifest for snaptb0-testExportWithTargetName at 1695031286395 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695031286418 (+23 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695031286430 (+12 ms) 2023-09-18 10:01:26,432 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-18 10:01:26,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 769 msec 2023-09-18 10:01:26,772 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:26,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-18 10:01:26,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:01:26,775 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775 2023-09-18 10:01:26,776 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44901, tgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775, rawTgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:26,816 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:26,816 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1308940820_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-18 10:01:26,816 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-18 10:01:26,840 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-18 10:01:26,914 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:26,915 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:26,915 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:26,916 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,870 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-8530188805149447428.jar 2023-09-18 10:01:27,871 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,872 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,939 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-5929944250434305430.jar 2023-09-18 10:01:27,940 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,940 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,941 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,941 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,942 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,942 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:27,943 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:01:27,943 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:01:27,944 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:01:27,944 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:01:27,944 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:01:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:01:27,945 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:01:27,946 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:01:27,946 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:01:27,947 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:01:27,951 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:27,951 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:27,952 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:01:27,952 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:27,952 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:27,953 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:01:27,953 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:01:28,769 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:01:28,776 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-18 10:01:28,785 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-18 10:01:29,244 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:01:29,246 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:01:29,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0001_000001 (auth:SIMPLE) 2023-09-18 10:01:29,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:01:34,172 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0001_000001 (auth:SIMPLE) 2023-09-18 10:01:36,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0001_000001 (auth:SIMPLE) 2023-09-18 10:01:39,130 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0001_000001 (auth:SIMPLE) 2023-09-18 10:01:40,643 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:01:40,647 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:01:40,658 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-18 10:01:40,658 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:01:40,659 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:01:40,659 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-18 10:01:40,660 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-18 10:01:40,660 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-18 10:01:40,660 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775/.hbase-snapshot/testExportWithTargetName 2023-09-18 10:01:40,660 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-18 10:01:40,660 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031286775/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-18 10:01:40,670 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-18 10:01:40,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-18 10:01:40,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:40,689 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031300688"}]},"ts":"1695031300688"} 2023-09-18 10:01:40,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-18 10:01:40,691 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-18 10:01:40,692 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-18 10:01:40,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, UNASSIGN}] 2023-09-18 10:01:40,697 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, UNASSIGN 2023-09-18 10:01:40,697 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, UNASSIGN 2023-09-18 10:01:40,698 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3898f4b07560e1560743c8d3dcf7512a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:40,698 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2907a96d58017ebaa8b09d1b4a52fbc7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:40,698 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031300698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031300698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031300698"}]},"ts":"1695031300698"} 2023-09-18 10:01:40,698 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031300698"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031300698"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031300698"}]},"ts":"1695031300698"} 2023-09-18 10:01:40,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 3898f4b07560e1560743c8d3dcf7512a, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:01:40,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 2907a96d58017ebaa8b09d1b4a52fbc7, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:01:40,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-18 10:01:40,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:40,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2907a96d58017ebaa8b09d1b4a52fbc7, disabling compactions & flushes 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3898f4b07560e1560743c8d3dcf7512a, disabling compactions & flushes 2023-09-18 10:01:40,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:40,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. after waiting 0 ms 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. after waiting 0 ms 2023-09-18 10:01:40,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:40,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:40,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:01:40,879 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:01:40,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:40,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:40,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7. 2023-09-18 10:01:40,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a. 2023-09-18 10:01:40,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2907a96d58017ebaa8b09d1b4a52fbc7: 2023-09-18 10:01:40,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3898f4b07560e1560743c8d3dcf7512a: 2023-09-18 10:01:40,883 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:40,884 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2907a96d58017ebaa8b09d1b4a52fbc7, regionState=CLOSED 2023-09-18 10:01:40,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:40,885 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031300884"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031300884"}]},"ts":"1695031300884"} 2023-09-18 10:01:40,886 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3898f4b07560e1560743c8d3dcf7512a, regionState=CLOSED 2023-09-18 10:01:40,886 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695031300886"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031300886"}]},"ts":"1695031300886"} 2023-09-18 10:01:40,890 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-18 10:01:40,891 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 2907a96d58017ebaa8b09d1b4a52fbc7, server=jenkins-hbase4.apache.org,45923,1695031276292 in 185 msec 2023-09-18 10:01:40,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-18 10:01:40,891 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 3898f4b07560e1560743c8d3dcf7512a, server=jenkins-hbase4.apache.org,33575,1695031276250 in 188 msec 2023-09-18 10:01:40,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2907a96d58017ebaa8b09d1b4a52fbc7, UNASSIGN in 197 msec 2023-09-18 10:01:40,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-18 10:01:40,894 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3898f4b07560e1560743c8d3dcf7512a, UNASSIGN in 197 msec 2023-09-18 10:01:40,895 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031300895"}]},"ts":"1695031300895"} 2023-09-18 10:01:40,897 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-18 10:01:40,898 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-18 10:01:40,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-09-18 10:01:40,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-18 10:01:40,992 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-18 10:01:40,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-18 10:01:41,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:41,009 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:41,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-18 10:01:41,011 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:41,015 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-18 10:01:41,017 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:41,017 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:41,018 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,018 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,018 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,018 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-18 10:01:41,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-18 10:01:41,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-18 10:01:41,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,020 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,022 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/recovered.edits] 2023-09-18 10:01:41,022 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/recovered.edits] 2023-09-18 10:01:41,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-18 10:01:41,031 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf/138030edc7b34498a87d11cf4b231f4c to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/cf/138030edc7b34498a87d11cf4b231f4c 2023-09-18 10:01:41,031 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf/ba1d646fd99e48b8bf0bffa157d55b95 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/cf/ba1d646fd99e48b8bf0bffa157d55b95 2023-09-18 10:01:41,035 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7/recovered.edits/9.seqid 2023-09-18 10:01:41,035 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a/recovered.edits/9.seqid 2023-09-18 10:01:41,036 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/2907a96d58017ebaa8b09d1b4a52fbc7 2023-09-18 10:01:41,036 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportWithTargetName/3898f4b07560e1560743c8d3dcf7512a 2023-09-18 10:01:41,036 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-18 10:01:41,037 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-18 10:01:41,038 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-18 10:01:41,042 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230918c082fde7a9174b87a2bb9d097f667ca5 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230918c082fde7a9174b87a2bb9d097f667ca5 2023-09-18 10:01:41,044 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091815eac411f0474c1da27afa780ae2526e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091815eac411f0474c1da27afa780ae2526e 2023-09-18 10:01:41,044 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-18 10:01:41,047 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:41,071 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-18 10:01:41,075 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-18 10:01:41,077 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:41,077 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-18 10:01:41,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031301077"}]},"ts":"9223372036854775807"} 2023-09-18 10:01:41,077 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031301077"}]},"ts":"9223372036854775807"} 2023-09-18 10:01:41,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-18 10:01:41,080 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3898f4b07560e1560743c8d3dcf7512a, NAME => 'testtb-testExportWithTargetName,,1695031283992.3898f4b07560e1560743c8d3dcf7512a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2907a96d58017ebaa8b09d1b4a52fbc7, NAME => 'testtb-testExportWithTargetName,1,1695031283992.2907a96d58017ebaa8b09d1b4a52fbc7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-18 10:01:41,080 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-18 10:01:41,080 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031301080"}]},"ts":"9223372036854775807"} 2023-09-18 10:01:41,084 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-18 10:01:41,086 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-18 10:01:41,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 86 msec 2023-09-18 10:01:41,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-18 10:01:41,126 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-18 10:01:41,144 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-18 10:01:41,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-18 10:01:41,151 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-18 10:01:41,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-18 10:01:41,187 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=756 (was 710) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:35292 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:43599 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:40033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_492355646_1 at /127.0.0.1:53448 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:38654 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:44087 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x614d5738-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:53482 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 101) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=8398 (was 9163) 2023-09-18 10:01:41,188 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-18 10:01:41,209 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=756, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=167, AvailableMemoryMB=8397 2023-09-18 10:01:41,209 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-09-18 10:01:41,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-18 10:01:41,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:41,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:01:41,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-18 10:01:41,219 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:01:41,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-18 10:01:41,222 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,222 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,222 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 empty. 2023-09-18 10:01:41,222 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 empty. 2023-09-18 10:01:41,223 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,223 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,223 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-18 10:01:41,235 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:41,236 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a0ad5c1f76fdf3afddd69926a4a2b640, NAME => 'testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:41,236 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45e98a45abcb3f25b3ddbea95db16246, NAME => 'testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:41,263 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:41,263 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 45e98a45abcb3f25b3ddbea95db16246, disabling compactions & flushes 2023-09-18 10:01:41,264 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,265 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. after waiting 0 ms 2023-09-18 10:01:41,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,268 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 45e98a45abcb3f25b3ddbea95db16246: 2023-09-18 10:01:41,270 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:41,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a0ad5c1f76fdf3afddd69926a4a2b640, disabling compactions & flushes 2023-09-18 10:01:41,271 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. after waiting 0 ms 2023-09-18 10:01:41,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,271 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,271 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a0ad5c1f76fdf3afddd69926a4a2b640: 2023-09-18 10:01:41,275 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:01:41,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031301276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031301276"}]},"ts":"1695031301276"} 2023-09-18 10:01:41,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031301276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031301276"}]},"ts":"1695031301276"} 2023-09-18 10:01:41,279 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:01:41,280 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:01:41,280 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031301280"}]},"ts":"1695031301280"} 2023-09-18 10:01:41,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-18 10:01:41,287 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:01:41,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:01:41,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:01:41,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:01:41,288 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:01:41,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, ASSIGN}] 2023-09-18 10:01:41,291 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, ASSIGN 2023-09-18 10:01:41,291 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, ASSIGN 2023-09-18 10:01:41,292 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34469,1695031276191; forceNewPlan=false, retain=false 2023-09-18 10:01:41,292 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:01:41,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-18 10:01:41,443 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:01:41,446 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a0ad5c1f76fdf3afddd69926a4a2b640, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,446 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=45e98a45abcb3f25b3ddbea95db16246, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,446 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031301445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031301445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031301445"}]},"ts":"1695031301445"} 2023-09-18 10:01:41,446 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031301445"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031301445"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031301445"}]},"ts":"1695031301445"} 2023-09-18 10:01:41,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure a0ad5c1f76fdf3afddd69926a4a2b640, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:01:41,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 45e98a45abcb3f25b3ddbea95db16246, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:01:41,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-18 10:01:41,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0ad5c1f76fdf3afddd69926a4a2b640, NAME => 'testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.', STARTKEY => '1', ENDKEY => ''} 2023-09-18 10:01:41,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. service=AccessControlService 2023-09-18 10:01:41,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:41,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:41,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45e98a45abcb3f25b3ddbea95db16246, NAME => 'testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.', STARTKEY => '', ENDKEY => '1'} 2023-09-18 10:01:41,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. service=AccessControlService 2023-09-18 10:01:41,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:41,614 INFO [StoreOpener-a0ad5c1f76fdf3afddd69926a4a2b640-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:41,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,616 INFO [StoreOpener-45e98a45abcb3f25b3ddbea95db16246-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,616 DEBUG [StoreOpener-a0ad5c1f76fdf3afddd69926a4a2b640-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf 2023-09-18 10:01:41,616 DEBUG [StoreOpener-a0ad5c1f76fdf3afddd69926a4a2b640-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf 2023-09-18 10:01:41,616 INFO [StoreOpener-a0ad5c1f76fdf3afddd69926a4a2b640-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0ad5c1f76fdf3afddd69926a4a2b640 columnFamilyName cf 2023-09-18 10:01:41,617 DEBUG [StoreOpener-45e98a45abcb3f25b3ddbea95db16246-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf 2023-09-18 10:01:41,617 DEBUG [StoreOpener-45e98a45abcb3f25b3ddbea95db16246-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf 2023-09-18 10:01:41,618 INFO [StoreOpener-45e98a45abcb3f25b3ddbea95db16246-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45e98a45abcb3f25b3ddbea95db16246 columnFamilyName cf 2023-09-18 10:01:41,618 INFO [StoreOpener-a0ad5c1f76fdf3afddd69926a4a2b640-1] regionserver.HStore(310): Store=a0ad5c1f76fdf3afddd69926a4a2b640/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:41,620 INFO [StoreOpener-45e98a45abcb3f25b3ddbea95db16246-1] regionserver.HStore(310): Store=45e98a45abcb3f25b3ddbea95db16246/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:41,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:41,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:41,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:41,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a0ad5c1f76fdf3afddd69926a4a2b640; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59434533, jitterRate=-0.11435644328594208}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:41,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a0ad5c1f76fdf3afddd69926a4a2b640: 2023-09-18 10:01:41,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640., pid=30, masterSystemTime=1695031301602 2023-09-18 10:01:41,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:41,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 45e98a45abcb3f25b3ddbea95db16246; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71928647, jitterRate=0.07182036340236664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:41,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 45e98a45abcb3f25b3ddbea95db16246: 2023-09-18 10:01:41,632 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a0ad5c1f76fdf3afddd69926a4a2b640, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246., pid=31, masterSystemTime=1695031301603 2023-09-18 10:01:41,632 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031301632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031301632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031301632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031301632"}]},"ts":"1695031301632"} 2023-09-18 10:01:41,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,635 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=45e98a45abcb3f25b3ddbea95db16246, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,636 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031301635"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031301635"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031301635"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031301635"}]},"ts":"1695031301635"} 2023-09-18 10:01:41,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-18 10:01:41,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure a0ad5c1f76fdf3afddd69926a4a2b640, server=jenkins-hbase4.apache.org,45923,1695031276292 in 186 msec 2023-09-18 10:01:41,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, ASSIGN in 351 msec 2023-09-18 10:01:41,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-18 10:01:41,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 45e98a45abcb3f25b3ddbea95db16246, server=jenkins-hbase4.apache.org,34469,1695031276191 in 187 msec 2023-09-18 10:01:41,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-18 10:01:41,646 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, ASSIGN in 355 msec 2023-09-18 10:01:41,647 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:01:41,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031301647"}]},"ts":"1695031301647"} 2023-09-18 10:01:41,648 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-18 10:01:41,651 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:01:41,651 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-18 10:01:41,653 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-18 10:01:41,654 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,655 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,655 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,654 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:41,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:41,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:41,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:41,657 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:41,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 445 msec 2023-09-18 10:01:41,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-18 10:01:41,823 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-18 10:01:41,826 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-18 10:01:41,827 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,829 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:41,838 DEBUG [hconnection-0x2d83dbed-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:41,845 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:41,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:01:41,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031301850 (current time:1695031301850). 2023-09-18 10:01:41,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:01:41,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x21ce48f9 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:41,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5aa913d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:41,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:41,860 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:41,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21ce48f9 to 127.0.0.1:57492 2023-09-18 10:01:41,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:41,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x73f6ffca to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:41,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20acf8cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:41,873 DEBUG [hconnection-0x320960b6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:41,876 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:41,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:41,882 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:41,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73f6ffca to 127.0.0.1:57492 2023-09-18 10:01:41,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:41,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-18 10:01:41,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:01:41,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:01:41,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:01:41,889 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:01:41,890 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695031901890 2023-09-18 10:01:41,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-18 10:01:41,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:01:41,892 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:01:41,892 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:01:41,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-18 10:01:41,893 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:01:41,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-18 10:01:41,896 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-18 10:01:41,897 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695031901897 2023-09-18 10:01:41,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,915 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-18 10:01:41,915 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:41,917 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-18 10:01:41,917 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-18 10:01:41,917 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,918 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,919 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:41,919 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:41,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:41,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:41,919 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:41,919 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:41,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:41,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:41,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:41,920 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,920 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,920 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,921 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-18 10:01:41,922 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-18 10:01:41,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-18 10:01:41,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:41,922 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-18 10:01:41,922 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,923 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-18 10:01:41,924 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-18 10:01:41,924 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-18 10:01:41,924 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-18 10:01:41,924 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:41,924 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:41,925 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-18 10:01:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-18 10:01:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-18 10:01:41,926 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-18 10:01:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-18 10:01:41,927 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-18 10:01:41,928 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,928 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:41,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:41,934 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,935 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,935 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:41,935 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,935 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:41,935 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,935 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,936 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a87c034[Count = 1] remaining members to acquire global barrier 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:41,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:41,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:41,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-18 10:01:41,940 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a87c034[Count = 0] remaining members to acquire global barrier 2023-09-18 10:01:41,940 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-18 10:01:41,940 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:01:41,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:41,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,942 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:01:41,942 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. started... 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:41,942 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-18 10:01:41,944 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:01:41,944 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,944 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:01:41,944 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0ad5c1f76fdf3afddd69926a4a2b640: 2023-09-18 10:01:41,942 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. started... 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45e98a45abcb3f25b3ddbea95db16246: 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:41,945 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:01:41,945 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-18 10:01:41,946 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:41,946 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-18 10:01:41,973 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. completed. 2023-09-18 10:01:41,973 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-18 10:01:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:01:41,978 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. completed. 2023-09-18 10:01:41,978 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-18 10:01:41,978 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:01:41,983 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-18 10:01:41,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:41,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:41,983 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,983 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-18 10:01:41,984 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-18 10:01:41,985 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:41,986 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-18 10:01:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:41,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34469,1695031276191': 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:41,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,992 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:01:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:41,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:41,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,993 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:01:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:01:41,995 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-18 10:01:41,995 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-18 10:01:41,995 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:01:41,995 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:01:41,995 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,995 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:41,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:41,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:41,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,997 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:41,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:41,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,998 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:41,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:41,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:41,999 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:41,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,017 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,017 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,018 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,021 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:42,021 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,023 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-18 10:01:42,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,023 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:01:42,023 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,024 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-18 10:01:42,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,038 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,069 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-18 10:01:42,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,070 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:42,070 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695031301890Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695031302037 (+147 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695031302037Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695031302037Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695031302043 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695031302058 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695031302069 (+11 ms) 2023-09-18 10:01:42,073 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-18 10:01:42,075 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 182 msec 2023-09-18 10:01:42,133 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-18 10:01:42,194 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:42,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:01:42,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:01:42,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34469] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:01:42,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:01:42,206 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-18 10:01:42,206 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:42,206 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:42,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:01:42,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031302223 (current time:1695031302223). 2023-09-18 10:01:42,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:01:42,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x30124f85 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:42,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c931b46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:42,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:42,238 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:42,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30124f85 to 127.0.0.1:57492 2023-09-18 10:01:42,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:42,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x64ca3aba to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:42,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@129b456c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:42,249 DEBUG [hconnection-0x70aa4f42-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:42,251 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:42,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:42,258 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64ca3aba to 127.0.0.1:57492 2023-09-18 10:01:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:42,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-18 10:01:42,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:01:42,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:01:42,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:01:42,264 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:01:42,265 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695031902265 2023-09-18 10:01:42,265 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-18 10:01:42,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:01:42,266 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:01:42,266 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:01:42,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-18 10:01:42,268 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:01:42,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-18 10:01:42,270 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-18 10:01:42,271 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695031902271 2023-09-18 10:01:42,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-18 10:01:42,289 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-18 10:01:42,289 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:42,291 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-18 10:01:42,291 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-18 10:01:42,292 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,292 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,293 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,293 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,293 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,293 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,294 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,294 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,295 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,295 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:01:42,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,295 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-18 10:01:42,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,295 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-18 10:01:42,295 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-18 10:01:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-18 10:01:42,296 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:42,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-18 10:01:42,297 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-18 10:01:42,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-18 10:01:42,297 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-18 10:01:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,297 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-18 10:01:42,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-18 10:01:42,298 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-18 10:01:42,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-18 10:01:42,298 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-18 10:01:42,298 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:42,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-18 10:01:42,298 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-18 10:01:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-18 10:01:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-18 10:01:42,299 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-18 10:01:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-18 10:01:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-18 10:01:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-18 10:01:42,302 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,303 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,303 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:42,303 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:42,304 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,304 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:42,305 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,305 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 1] remaining members to acquire global barrier 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:42,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:42,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-18 10:01:42,309 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeca876[Count = 0] remaining members to acquire global barrier 2023-09-18 10:01:42,309 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-18 10:01:42,309 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:01:42,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,311 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,311 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:01:42,311 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-18 10:01:42,311 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:01:42,311 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:01:42,312 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,312 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:01:42,312 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:42,312 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:42,312 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:42,312 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. started... 2023-09-18 10:01:42,313 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45e98a45abcb3f25b3ddbea95db16246 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-18 10:01:42,313 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:42,313 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:42,313 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:42,313 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. started... 2023-09-18 10:01:42,313 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0ad5c1f76fdf3afddd69926a4a2b640 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-18 10:01:42,314 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-18 10:01:42,314 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:42,314 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-18 10:01:42,356 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230918a7040d6853744636b3ea93451fcace7e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230918a7040d6853744636b3ea93451fcace7e 2023-09-18 10:01:42,359 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230918d528335ce05744a08e4783c94e362675 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230918d528335ce05744a08e4783c94e362675 2023-09-18 10:01:42,366 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:42,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:01:42,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:42,374 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:01:42,385 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/.tmp/cf/8983c84af99848cc9eb2ff24b06a68cd 2023-09-18 10:01:42,393 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/.tmp/cf/b877f38a66314462917b1f33613c9f82 2023-09-18 10:01:42,394 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/.tmp/cf/8983c84af99848cc9eb2ff24b06a68cd as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf/8983c84af99848cc9eb2ff24b06a68cd 2023-09-18 10:01:42,401 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/.tmp/cf/b877f38a66314462917b1f33613c9f82 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf/b877f38a66314462917b1f33613c9f82 2023-09-18 10:01:42,403 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf/8983c84af99848cc9eb2ff24b06a68cd, entries=5, sequenceid=6, filesize=5.7 K 2023-09-18 10:01:42,405 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 45e98a45abcb3f25b3ddbea95db16246 in 92ms, sequenceid=6, compaction requested=false 2023-09-18 10:01:42,406 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45e98a45abcb3f25b3ddbea95db16246: 2023-09-18 10:01:42,407 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-18 10:01:42,407 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:42,407 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf/8983c84af99848cc9eb2ff24b06a68cd] hfiles 2023-09-18 10:01:42,407 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf/8983c84af99848cc9eb2ff24b06a68cd for snapshot=snaptb0-testExportFileSystemState 2023-09-18 10:01:42,414 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf/b877f38a66314462917b1f33613c9f82, entries=45, sequenceid=6, filesize=12.5 K 2023-09-18 10:01:42,416 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a0ad5c1f76fdf3afddd69926a4a2b640 in 102ms, sequenceid=6, compaction requested=false 2023-09-18 10:01:42,416 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0ad5c1f76fdf3afddd69926a4a2b640: 2023-09-18 10:01:42,416 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-18 10:01:42,416 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:42,416 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf/b877f38a66314462917b1f33613c9f82] hfiles 2023-09-18 10:01:42,416 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf/b877f38a66314462917b1f33613c9f82 for snapshot=snaptb0-testExportFileSystemState 2023-09-18 10:01:42,425 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. completed. 2023-09-18 10:01:42,425 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-18 10:01:42,425 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:01:42,430 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-18 10:01:42,430 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,430 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:42,430 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-18 10:01:42,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:42,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:42,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34469,1695031276191': 2023-09-18 10:01:42,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-18 10:01:42,438 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. completed. 2023-09-18 10:01:42,438 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:42,438 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:42,438 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:42,438 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,438 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-18 10:01:42,438 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:01:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-18 10:01:42,440 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:42,440 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-18 10:01:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:01:42,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-18 10:01:42,447 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-18 10:01:42,447 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:01:42,447 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:01:42,447 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-18 10:01:42,447 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:42,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,450 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:42,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,451 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:42,452 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:42,454 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-18 10:01:42,455 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,455 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,458 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-18 10:01:42,459 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:42,459 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,461 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:42,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-18 10:01:42,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:01:42,461 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:42,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,461 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,461 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:42,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:42,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:42,461 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:42,462 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,462 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:42,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230918d528335ce05744a08e4783c94e362675, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230918a7040d6853744636b3ea93451fcace7e] mob files 2023-09-18 10:01:42,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230918d528335ce05744a08e4783c94e362675 2023-09-18 10:01:42,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230918a7040d6853744636b3ea93451fcace7e 2023-09-18 10:01:42,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-18 10:01:42,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-18 10:01:42,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,509 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,509 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695031302265Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695031302474 (+209 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695031302474Loading Region manifests for snaptb0-testExportFileSystemState at 1695031302474Writing data manifest for snaptb0-testExportFileSystemState at 1695031302479 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695031302494 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695031302508 (+14 ms) 2023-09-18 10:01:42,512 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-18 10:01:42,514 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 246 msec 2023-09-18 10:01:42,574 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:42,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:01:42,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:01:42,576 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576 2023-09-18 10:01:42,576 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44901, tgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576, rawTgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:42,607 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:42,607 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1067350313_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,607 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-18 10:01:42,623 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-18 10:01:42,669 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:42,670 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:42,670 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:42,670 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,609 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-1438553706372501997.jar 2023-09-18 10:01:43,610 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,610 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,681 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-2835065396919646150.jar 2023-09-18 10:01:43,681 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,682 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,682 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,683 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,683 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,683 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:43,684 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:01:43,684 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:01:43,684 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:01:43,685 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:01:43,685 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:01:43,686 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:01:43,686 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:01:43,686 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:01:43,687 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:01:43,687 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:01:43,688 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:43,688 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:43,689 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:01:43,689 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:43,689 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:01:43,690 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:01:43,691 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:01:44,173 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:01:44,175 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-18 10:01:44,178 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-18 10:01:45,329 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:01:45,330 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:01:45,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0001_000001 (auth:SIMPLE) 2023-09-18 10:01:45,888 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0002_000001 (auth:SIMPLE) 2023-09-18 10:01:46,487 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:01:50,267 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0002_000001 (auth:SIMPLE) 2023-09-18 10:01:52,511 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0002_000001 (auth:SIMPLE) 2023-09-18 10:01:55,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0002_000001 (auth:SIMPLE) 2023-09-18 10:01:57,506 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:01:57,507 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:01:57,516 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-18 10:01:57,516 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:01:57,517 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:01:57,517 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-18 10:01:57,517 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-18 10:01:57,517 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-18 10:01:57,517 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-18 10:01:57,518 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-18 10:01:57,518 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031302576/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-18 10:01:57,526 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-18 10:01:57,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-18 10:01:57,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-18 10:01:57,533 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031317533"}]},"ts":"1695031317533"} 2023-09-18 10:01:57,534 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-18 10:01:57,536 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-18 10:01:57,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, UNASSIGN}] 2023-09-18 10:01:57,540 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, UNASSIGN 2023-09-18 10:01:57,540 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, UNASSIGN 2023-09-18 10:01:57,541 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a0ad5c1f76fdf3afddd69926a4a2b640, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:57,541 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=45e98a45abcb3f25b3ddbea95db16246, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:57,541 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031317541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031317541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031317541"}]},"ts":"1695031317541"} 2023-09-18 10:01:57,541 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031317541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031317541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031317541"}]},"ts":"1695031317541"} 2023-09-18 10:01:57,542 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure a0ad5c1f76fdf3afddd69926a4a2b640, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:01:57,543 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 45e98a45abcb3f25b3ddbea95db16246, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:01:57,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-18 10:01:57,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:57,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a0ad5c1f76fdf3afddd69926a4a2b640, disabling compactions & flushes 2023-09-18 10:01:57,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:57,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:57,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. after waiting 0 ms 2023-09-18 10:01:57,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:57,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:57,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 45e98a45abcb3f25b3ddbea95db16246, disabling compactions & flushes 2023-09-18 10:01:57,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:57,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:57,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. after waiting 0 ms 2023-09-18 10:01:57,700 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:57,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:01:57,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:01:57,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:57,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640. 2023-09-18 10:01:57,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a0ad5c1f76fdf3afddd69926a4a2b640: 2023-09-18 10:01:57,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:01:57,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246. 2023-09-18 10:01:57,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 45e98a45abcb3f25b3ddbea95db16246: 2023-09-18 10:01:57,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:57,710 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a0ad5c1f76fdf3afddd69926a4a2b640, regionState=CLOSED 2023-09-18 10:01:57,710 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031317710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031317710"}]},"ts":"1695031317710"} 2023-09-18 10:01:57,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:57,711 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=45e98a45abcb3f25b3ddbea95db16246, regionState=CLOSED 2023-09-18 10:01:57,711 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695031317711"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031317711"}]},"ts":"1695031317711"} 2023-09-18 10:01:57,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-18 10:01:57,714 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure a0ad5c1f76fdf3afddd69926a4a2b640, server=jenkins-hbase4.apache.org,45923,1695031276292 in 170 msec 2023-09-18 10:01:57,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-18 10:01:57,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 45e98a45abcb3f25b3ddbea95db16246, server=jenkins-hbase4.apache.org,34469,1695031276191 in 169 msec 2023-09-18 10:01:57,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a0ad5c1f76fdf3afddd69926a4a2b640, UNASSIGN in 177 msec 2023-09-18 10:01:57,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-18 10:01:57,716 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=45e98a45abcb3f25b3ddbea95db16246, UNASSIGN in 177 msec 2023-09-18 10:01:57,717 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031317717"}]},"ts":"1695031317717"} 2023-09-18 10:01:57,719 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-18 10:01:57,720 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-18 10:01:57,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-09-18 10:01:57,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-18 10:01:57,835 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-18 10:01:57,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-18 10:01:57,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,840 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-18 10:01:57,841 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,842 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-18 10:01:57,846 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,846 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,846 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,846 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,846 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-18 10:01:57,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-18 10:01:57,847 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:57,847 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:57,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-18 10:01:57,847 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:57,848 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:57,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-18 10:01:57,849 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/recovered.edits] 2023-09-18 10:01:57,850 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/recovered.edits] 2023-09-18 10:01:57,854 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf/8983c84af99848cc9eb2ff24b06a68cd to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/cf/8983c84af99848cc9eb2ff24b06a68cd 2023-09-18 10:01:57,855 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf/b877f38a66314462917b1f33613c9f82 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/cf/b877f38a66314462917b1f33613c9f82 2023-09-18 10:01:57,858 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246/recovered.edits/9.seqid 2023-09-18 10:01:57,859 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640/recovered.edits/9.seqid 2023-09-18 10:01:57,859 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/45e98a45abcb3f25b3ddbea95db16246 2023-09-18 10:01:57,859 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemState/a0ad5c1f76fdf3afddd69926a4a2b640 2023-09-18 10:01:57,859 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-18 10:01:57,860 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-18 10:01:57,861 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-18 10:01:57,864 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230918d528335ce05744a08e4783c94e362675 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230918d528335ce05744a08e4783c94e362675 2023-09-18 10:01:57,866 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230918a7040d6853744636b3ea93451fcace7e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230918a7040d6853744636b3ea93451fcace7e 2023-09-18 10:01:57,866 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-18 10:01:57,869 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,872 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-18 10:01:57,874 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-18 10:01:57,876 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,876 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-18 10:01:57,876 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031317876"}]},"ts":"9223372036854775807"} 2023-09-18 10:01:57,876 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031317876"}]},"ts":"9223372036854775807"} 2023-09-18 10:01:57,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-18 10:01:57,880 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45e98a45abcb3f25b3ddbea95db16246, NAME => 'testtb-testExportFileSystemState,,1695031301211.45e98a45abcb3f25b3ddbea95db16246.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a0ad5c1f76fdf3afddd69926a4a2b640, NAME => 'testtb-testExportFileSystemState,1,1695031301211.a0ad5c1f76fdf3afddd69926a4a2b640.', STARTKEY => '1', ENDKEY => ''}] 2023-09-18 10:01:57,880 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-18 10:01:57,881 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031317880"}]},"ts":"9223372036854775807"} 2023-09-18 10:01:57,883 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-18 10:01:57,885 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-18 10:01:57,887 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-09-18 10:01:57,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-18 10:01:57,951 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-18 10:01:57,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-18 10:01:57,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-18 10:01:57,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-18 10:01:57,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-18 10:01:57,998 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:43974 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1965 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:46005 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x614d5738-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_54357374_1 at /127.0.0.1:43936 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:35022 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:54508 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 923) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 208) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=8213 (was 8397) 2023-09-18 10:01:57,998 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-18 10:01:58,022 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=167, AvailableMemoryMB=8211 2023-09-18 10:01:58,022 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-18 10:01:58,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-18 10:01:58,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:01:58,029 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:01:58,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-18 10:01:58,030 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:01:58,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-18 10:01:58,033 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,033 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,034 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 empty. 2023-09-18 10:01:58,034 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a empty. 2023-09-18 10:01:58,034 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,035 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,035 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-18 10:01:58,049 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-18 10:01:58,051 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2b19fbf7f369c8f29baec9c8697110a, NAME => 'testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:58,051 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9323a89568527ac5842fa3f8265f4600, NAME => 'testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:01:58,064 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:58,064 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing a2b19fbf7f369c8f29baec9c8697110a, disabling compactions & flushes 2023-09-18 10:01:58,064 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,065 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,065 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. after waiting 0 ms 2023-09-18 10:01:58,065 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,065 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,065 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for a2b19fbf7f369c8f29baec9c8697110a: 2023-09-18 10:01:58,067 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:58,067 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 9323a89568527ac5842fa3f8265f4600, disabling compactions & flushes 2023-09-18 10:01:58,067 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,067 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,067 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. after waiting 0 ms 2023-09-18 10:01:58,067 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,067 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,067 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 9323a89568527ac5842fa3f8265f4600: 2023-09-18 10:01:58,069 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:01:58,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031318070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031318070"}]},"ts":"1695031318070"} 2023-09-18 10:01:58,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031318070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031318070"}]},"ts":"1695031318070"} 2023-09-18 10:01:58,073 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:01:58,074 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:01:58,074 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031318074"}]},"ts":"1695031318074"} 2023-09-18 10:01:58,076 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-18 10:01:58,080 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:01:58,081 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:01:58,081 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:01:58,082 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:01:58,082 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:01:58,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, ASSIGN}] 2023-09-18 10:01:58,085 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, ASSIGN 2023-09-18 10:01:58,085 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, ASSIGN 2023-09-18 10:01:58,086 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:01:58,086 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34469,1695031276191; forceNewPlan=false, retain=false 2023-09-18 10:01:58,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-18 10:01:58,236 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:01:58,239 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a2b19fbf7f369c8f29baec9c8697110a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,239 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9323a89568527ac5842fa3f8265f4600, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,239 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031318239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031318239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031318239"}]},"ts":"1695031318239"} 2023-09-18 10:01:58,239 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031318239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031318239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031318239"}]},"ts":"1695031318239"} 2023-09-18 10:01:58,241 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure a2b19fbf7f369c8f29baec9c8697110a, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:01:58,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 9323a89568527ac5842fa3f8265f4600, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:01:58,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-18 10:01:58,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2b19fbf7f369c8f29baec9c8697110a, NAME => 'testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.', STARTKEY => '', ENDKEY => '1'} 2023-09-18 10:01:58,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9323a89568527ac5842fa3f8265f4600, NAME => 'testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.', STARTKEY => '1', ENDKEY => ''} 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. service=AccessControlService 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. service=AccessControlService 2023-09-18 10:01:58,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:58,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,400 INFO [StoreOpener-a2b19fbf7f369c8f29baec9c8697110a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,400 INFO [StoreOpener-9323a89568527ac5842fa3f8265f4600-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,401 DEBUG [StoreOpener-a2b19fbf7f369c8f29baec9c8697110a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf 2023-09-18 10:01:58,401 DEBUG [StoreOpener-a2b19fbf7f369c8f29baec9c8697110a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf 2023-09-18 10:01:58,401 DEBUG [StoreOpener-9323a89568527ac5842fa3f8265f4600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf 2023-09-18 10:01:58,401 DEBUG [StoreOpener-9323a89568527ac5842fa3f8265f4600-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf 2023-09-18 10:01:58,401 INFO [StoreOpener-a2b19fbf7f369c8f29baec9c8697110a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2b19fbf7f369c8f29baec9c8697110a columnFamilyName cf 2023-09-18 10:01:58,402 INFO [StoreOpener-9323a89568527ac5842fa3f8265f4600-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9323a89568527ac5842fa3f8265f4600 columnFamilyName cf 2023-09-18 10:01:58,403 INFO [StoreOpener-9323a89568527ac5842fa3f8265f4600-1] regionserver.HStore(310): Store=9323a89568527ac5842fa3f8265f4600/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:58,403 INFO [StoreOpener-a2b19fbf7f369c8f29baec9c8697110a-1] regionserver.HStore(310): Store=a2b19fbf7f369c8f29baec9c8697110a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:01:58,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:01:58,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:01:58,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:58,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:01:58,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2b19fbf7f369c8f29baec9c8697110a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70683705, jitterRate=0.05326928198337555}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:58,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2b19fbf7f369c8f29baec9c8697110a: 2023-09-18 10:01:58,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9323a89568527ac5842fa3f8265f4600; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73556195, jitterRate=0.096072718501091}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:01:58,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9323a89568527ac5842fa3f8265f4600: 2023-09-18 10:01:58,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a., pid=45, masterSystemTime=1695031318393 2023-09-18 10:01:58,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600., pid=46, masterSystemTime=1695031318394 2023-09-18 10:01:58,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,414 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=a2b19fbf7f369c8f29baec9c8697110a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,415 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031318414"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031318414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031318414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031318414"}]},"ts":"1695031318414"} 2023-09-18 10:01:58,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,415 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9323a89568527ac5842fa3f8265f4600, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031318415"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031318415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031318415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031318415"}]},"ts":"1695031318415"} 2023-09-18 10:01:58,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-18 10:01:58,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure a2b19fbf7f369c8f29baec9c8697110a, server=jenkins-hbase4.apache.org,34469,1695031276191 in 175 msec 2023-09-18 10:01:58,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-18 10:01:58,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 9323a89568527ac5842fa3f8265f4600, server=jenkins-hbase4.apache.org,45923,1695031276292 in 176 msec 2023-09-18 10:01:58,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, ASSIGN in 337 msec 2023-09-18 10:01:58,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-18 10:01:58,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, ASSIGN in 338 msec 2023-09-18 10:01:58,423 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:01:58,423 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031318423"}]},"ts":"1695031318423"} 2023-09-18 10:01:58,424 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-18 10:01:58,427 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:01:58,427 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-18 10:01:58,429 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-18 10:01:58,430 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:58,430 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:58,430 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:58,430 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:01:58,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:58,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:58,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:58,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-18 10:01:58,434 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 407 msec 2023-09-18 10:01:58,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-18 10:01:58,635 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-18 10:01:58,637 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-18 10:01:58,637 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,639 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:58,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-18 10:01:58,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031318651 (current time:1695031318651). 2023-09-18 10:01:58,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:01:58,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x39795f9b to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:58,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6705d01c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:58,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:58,673 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39795f9b to 127.0.0.1:57492 2023-09-18 10:01:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:58,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x4fe4557b to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:58,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c124e9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:58,682 DEBUG [hconnection-0x755eec35-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:58,685 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:58,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:58,691 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:58,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fe4557b to 127.0.0.1:57492 2023-09-18 10:01:58,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:58,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-18 10:01:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:01:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-18 10:01:58,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-18 10:01:58,696 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-18 10:01:58,696 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695031918696 2023-09-18 10:01:58,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-18 10:01:58,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-18 10:01:58,698 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:01:58,698 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:01:58,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-18 10:01:58,701 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-18 10:01:58,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-18 10:01:58,703 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-18 10:01:58,704 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695031918704 2023-09-18 10:01:58,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,720 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-18 10:01:58,720 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:58,721 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-18 10:01:58,721 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-18 10:01:58,722 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,722 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:58,724 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:58,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:58,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:58,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:58,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:58,725 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:58,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:58,725 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,725 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,725 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:01:58,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-18 10:01:58,726 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-18 10:01:58,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-18 10:01:58,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-18 10:01:58,727 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:58,728 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-18 10:01:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-18 10:01:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-18 10:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-18 10:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-18 10:01:58,728 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-18 10:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-18 10:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-18 10:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-18 10:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-18 10:01:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,734 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,734 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:58,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,734 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,735 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:58,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 1] remaining members to acquire global barrier 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:58,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:58,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-18 10:01:58,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@773c6244[Count = 0] remaining members to acquire global barrier 2023-09-18 10:01:58,739 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-18 10:01:58,739 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-18 10:01:58,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-18 10:01:58,741 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:58,741 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-18 10:01:58,741 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,741 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:01:58,741 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,741 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. started... 2023-09-18 10:01:58,741 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. started... 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:58,743 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2b19fbf7f369c8f29baec9c8697110a: 2023-09-18 10:01:58,743 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9323a89568527ac5842fa3f8265f4600: 2023-09-18 10:01:58,743 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,743 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,744 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:58,744 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:01:58,744 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:58,744 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:01:58,756 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. completed. 2023-09-18 10:01:58,756 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-18 10:01:58,756 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:58,756 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:58,756 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-18 10:01:58,756 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:58,758 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. completed. 2023-09-18 10:01:58,758 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-18 10:01:58,758 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:01:58,759 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-18 10:01:58,760 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-18 10:01:58,760 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:58,760 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,760 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-18 10:01:58,760 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:58,761 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,761 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-18 10:01:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:58,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34469,1695031276191': 2023-09-18 10:01:58,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:01:58,769 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-18 10:01:58,769 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-18 10:01:58,769 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:01:58,769 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:01:58,769 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,769 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:01:58,770 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,770 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,770 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:58,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,770 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,770 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:58,771 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:58,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,770 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:58,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:58,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:58,772 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:58,772 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,773 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,775 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,775 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,775 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:58,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:58,780 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,780 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,781 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:58,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-18 10:01:58,781 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,780 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:58,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,781 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:58,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:01:58,782 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:58,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:58,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:58,782 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,782 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:58,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:58,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-18 10:01:58,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,798 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:58,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-18 10:01:58,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:58,799 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:01:58,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,809 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-18 10:01:58,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,810 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-18 10:01:58,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695031318697Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695031318791 (+94 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695031318791Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695031318791Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695031318795 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695031318803 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695031318809 (+6 ms) 2023-09-18 10:01:58,812 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-18 10:01:58,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 116 msec 2023-09-18 10:01:58,999 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:59,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-18 10:01:59,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:01:59,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34469] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:01:59,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:01:59,008 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-18 10:01:59,008 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:59,009 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:01:59,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-18 10:01:59,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031319019 (current time:1695031319019). 2023-09-18 10:01:59,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:01:59,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x393f97b8 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:59,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@260a92da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:59,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:59,035 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:59,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x393f97b8 to 127.0.0.1:57492 2023-09-18 10:01:59,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:59,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x4fda3d93 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:01:59,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a9df187, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:01:59,050 DEBUG [hconnection-0x78f32e4c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:59,052 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:59,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:01:59,057 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:01:59,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fda3d93 to 127.0.0.1:57492 2023-09-18 10:01:59,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:01:59,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-18 10:01:59,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:01:59,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-18 10:01:59,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-18 10:01:59,063 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-18 10:01:59,064 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695031919064 2023-09-18 10:01:59,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-18 10:01:59,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-18 10:01:59,065 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:01:59,065 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:01:59,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-18 10:01:59,066 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-18 10:01:59,068 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-18 10:01:59,068 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-18 10:01:59,069 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695031919069 2023-09-18 10:01:59,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-18 10:01:59,081 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-18 10:01:59,081 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:59,082 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-18 10:01:59,082 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-18 10:01:59,082 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,083 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,085 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:59,085 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:59,085 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,085 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,086 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,086 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,086 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-18 10:01:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-18 10:01:59,086 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:01:59,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-18 10:01:59,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-18 10:01:59,087 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-18 10:01:59,087 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:59,088 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-18 10:01:59,088 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-18 10:01:59,088 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-18 10:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-18 10:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-18 10:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-18 10:01:59,089 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-18 10:01:59,089 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-18 10:01:59,089 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-18 10:01:59,089 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-18 10:01:59,090 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:59,091 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,091 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:59,092 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,092 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,092 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:59,092 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,092 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:01:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 1] remaining members to acquire global barrier 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:59,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-18 10:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2adbad38[Count = 0] remaining members to acquire global barrier 2023-09-18 10:01:59,096 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-18 10:01:59,096 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-18 10:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-18 10:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,098 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,098 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:01:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-18 10:01:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-18 10:01:59,098 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:01:59,099 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:59,099 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:59,099 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:01:59,099 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:01:59,099 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:59,099 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:59,099 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. started... 2023-09-18 10:01:59,099 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. started... 2023-09-18 10:01:59,099 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a2b19fbf7f369c8f29baec9c8697110a 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-18 10:01:59,099 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9323a89568527ac5842fa3f8265f4600 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-18 10:01:59,101 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-18 10:01:59,102 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:59,102 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-18 10:01:59,133 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230918a5c55f8847d540daa2f6e7763895ace5 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230918a5c55f8847d540daa2f6e7763895ace5 2023-09-18 10:01:59,133 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091899ad9932c63b4825ac07410f1b8783f2 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091899ad9932c63b4825ac07410f1b8783f2 2023-09-18 10:01:59,151 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/.tmp/cf/3c1de505529f4290a69b1a0dfc2d6809 2023-09-18 10:01:59,151 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/.tmp/cf/34f95c71b8df4fb7b8278d8a418e5a03 2023-09-18 10:01:59,157 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/.tmp/cf/34f95c71b8df4fb7b8278d8a418e5a03 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf/34f95c71b8df4fb7b8278d8a418e5a03 2023-09-18 10:01:59,157 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/.tmp/cf/3c1de505529f4290a69b1a0dfc2d6809 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf/3c1de505529f4290a69b1a0dfc2d6809 2023-09-18 10:01:59,162 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf/3c1de505529f4290a69b1a0dfc2d6809, entries=46, sequenceid=6, filesize=12.5 K 2023-09-18 10:01:59,162 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf/34f95c71b8df4fb7b8278d8a418e5a03, entries=4, sequenceid=6, filesize=5.6 K 2023-09-18 10:01:59,163 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for a2b19fbf7f369c8f29baec9c8697110a in 64ms, sequenceid=6, compaction requested=false 2023-09-18 10:01:59,163 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9323a89568527ac5842fa3f8265f4600 in 64ms, sequenceid=6, compaction requested=false 2023-09-18 10:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-18 10:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-18 10:01:59,165 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a2b19fbf7f369c8f29baec9c8697110a: 2023-09-18 10:01:59,165 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9323a89568527ac5842fa3f8265f4600: 2023-09-18 10:01:59,165 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-18 10:01:59,165 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:59,165 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:59,165 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-18 10:01:59,166 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf/34f95c71b8df4fb7b8278d8a418e5a03] hfiles 2023-09-18 10:01:59,166 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:01:59,166 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf/34f95c71b8df4fb7b8278d8a418e5a03 for snapshot=snaptb0-testConsecutiveExports 2023-09-18 10:01:59,166 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf/3c1de505529f4290a69b1a0dfc2d6809] hfiles 2023-09-18 10:01:59,166 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf/3c1de505529f4290a69b1a0dfc2d6809 for snapshot=snaptb0-testConsecutiveExports 2023-09-18 10:01:59,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-18 10:01:59,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:01:59,167 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:01:59,176 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. completed. 2023-09-18 10:01:59,176 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:01:59,176 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:59,177 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:59,177 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,177 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-18 10:01:59,177 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:01:59,179 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. completed. 2023-09-18 10:01:59,179 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:01:59,179 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-18 10:01:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:59,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:59,179 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-18 10:01:59,183 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-18 10:01:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:59,183 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-18 10:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:59,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34469,1695031276191': 2023-09-18 10:01:59,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-18 10:01:59,193 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-18 10:01:59,193 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:01:59,193 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:01:59,193 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-18 10:01:59,193 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:01:59,194 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,194 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,194 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:59,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:01:59,195 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:59,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:59,195 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:59,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:01:59,195 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:59,195 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,196 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,197 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:01:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:01:59,198 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-18 10:01:59,199 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,199 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:59,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:59,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:59,207 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:59,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-18 10:01:59,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:59,209 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-18 10:01:59,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-18 10:01:59,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:01:59,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:01:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:01:59,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:59,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:01:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:59,209 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:01:59,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:59,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,210 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230918a5c55f8847d540daa2f6e7763895ace5, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091899ad9932c63b4825ac07410f1b8783f2] mob files 2023-09-18 10:01:59,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230918a5c55f8847d540daa2f6e7763895ace5 2023-09-18 10:01:59,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091899ad9932c63b4825ac07410f1b8783f2 2023-09-18 10:01:59,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-18 10:01:59,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-18 10:01:59,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,246 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695031319064Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695031319222 (+158 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695031319222Loading Region manifests for snaptb0-testConsecutiveExports at 1695031319222Writing data manifest for snaptb0-testConsecutiveExports at 1695031319226 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695031319237 (+11 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695031319246 (+9 ms) 2023-09-18 10:01:59,249 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-18 10:01:59,251 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 185 msec 2023-09-18 10:01:59,367 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:01:59,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-18 10:01:59,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:01:59,369 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369 2023-09-18 10:01:59,369 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:59,392 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:01:59,392 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5b5c38fd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,392 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-18 10:01:59,401 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:01:59,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:59,414 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:59,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:01:59,415 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,296 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-5652292909775465878.jar 2023-09-18 10:02:00,296 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,297 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,363 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-2799457335717616901.jar 2023-09-18 10:02:00,364 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,364 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,365 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,365 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,366 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,366 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:00,366 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:02:00,367 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:02:00,367 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:02:00,367 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:02:00,368 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:02:00,368 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:02:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:02:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:02:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:02:00,370 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:02:00,370 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:00,371 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:00,371 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:00,372 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:00,372 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:00,372 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:00,373 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:00,749 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:02:00,751 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-18 10:02:00,754 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-18 10:02:01,953 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:01,953 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:01,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0002_000001 (auth:SIMPLE) 2023-09-18 10:02:02,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0003_000001 (auth:SIMPLE) 2023-09-18 10:02:03,293 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:02:06,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0003_000001 (auth:SIMPLE) 2023-09-18 10:02:08,835 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0003_000001 (auth:SIMPLE) 2023-09-18 10:02:11,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0003_000001 (auth:SIMPLE) 2023-09-18 10:02:12,955 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:02:12,955 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:02:12,960 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-18 10:02:12,960 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:02:12,961 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:02:12,961 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-18 10:02:12,963 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-18 10:02:12,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-18 10:02:12,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e901656 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-18 10:02:12,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-18 10:02:12,964 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-18 10:02:12,965 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:12,987 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:12,987 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@70d38673, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:02:12,988 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-18 10:02:12,999 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-18 10:02:13,011 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,012 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,012 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,012 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,886 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-2243869299481717665.jar 2023-09-18 10:02:13,886 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,887 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,953 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-7029842819534696627.jar 2023-09-18 10:02:13,953 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,954 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,954 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,955 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,955 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,955 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:02:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:02:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:02:13,957 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:02:13,957 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:02:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:02:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:02:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:02:13,959 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:02:13,959 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:02:13,960 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:13,960 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:13,961 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:13,961 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:13,961 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:13,962 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:13,962 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:14,321 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:02:14,323 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-18 10:02:14,326 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-18 10:02:17,364 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:17,364 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:17,367 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0003_000001 (auth:SIMPLE) 2023-09-18 10:02:17,966 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0004_000001 (auth:SIMPLE) 2023-09-18 10:02:21,700 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0004_000001 (auth:SIMPLE) 2023-09-18 10:02:23,909 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0004_000001 (auth:SIMPLE) 2023-09-18 10:02:26,190 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0004_000001 (auth:SIMPLE) 2023-09-18 10:02:27,488 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:02:27,489 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:02:27,492 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-18 10:02:27,492 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:02:27,492 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:02:27,492 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-18 10:02:27,496 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-18 10:02:27,496 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-18 10:02:27,497 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1e901656 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-18 10:02:27,497 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-18 10:02:27,497 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/local-export-1695031319369/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-18 10:02:27,510 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-18 10:02:27,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-18 10:02:27,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-18 10:02:27,515 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031347514"}]},"ts":"1695031347514"} 2023-09-18 10:02:27,516 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-18 10:02:27,518 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-18 10:02:27,518 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, UNASSIGN}] 2023-09-18 10:02:27,520 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, UNASSIGN 2023-09-18 10:02:27,520 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, UNASSIGN 2023-09-18 10:02:27,521 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a2b19fbf7f369c8f29baec9c8697110a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:27,521 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031347521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031347521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031347521"}]},"ts":"1695031347521"} 2023-09-18 10:02:27,521 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9323a89568527ac5842fa3f8265f4600, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:27,521 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031347521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031347521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031347521"}]},"ts":"1695031347521"} 2023-09-18 10:02:27,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure a2b19fbf7f369c8f29baec9c8697110a, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:02:27,523 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 9323a89568527ac5842fa3f8265f4600, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:27,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-18 10:02:27,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2b19fbf7f369c8f29baec9c8697110a, disabling compactions & flushes 2023-09-18 10:02:27,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. after waiting 0 ms 2023-09-18 10:02:27,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:02:27,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:02:27,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9323a89568527ac5842fa3f8265f4600, disabling compactions & flushes 2023-09-18 10:02:27,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:02:27,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:02:27,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. after waiting 0 ms 2023-09-18 10:02:27,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:02:27,688 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:02:27,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:02:27,689 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:27,690 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:27,690 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a. 2023-09-18 10:02:27,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600. 2023-09-18 10:02:27,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2b19fbf7f369c8f29baec9c8697110a: 2023-09-18 10:02:27,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9323a89568527ac5842fa3f8265f4600: 2023-09-18 10:02:27,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:02:27,693 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=a2b19fbf7f369c8f29baec9c8697110a, regionState=CLOSED 2023-09-18 10:02:27,693 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031347693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031347693"}]},"ts":"1695031347693"} 2023-09-18 10:02:27,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9323a89568527ac5842fa3f8265f4600 2023-09-18 10:02:27,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9323a89568527ac5842fa3f8265f4600, regionState=CLOSED 2023-09-18 10:02:27,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695031347695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031347695"}]},"ts":"1695031347695"} 2023-09-18 10:02:27,696 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-18 10:02:27,697 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure a2b19fbf7f369c8f29baec9c8697110a, server=jenkins-hbase4.apache.org,34469,1695031276191 in 172 msec 2023-09-18 10:02:27,698 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a2b19fbf7f369c8f29baec9c8697110a, UNASSIGN in 179 msec 2023-09-18 10:02:27,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-18 10:02:27,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 9323a89568527ac5842fa3f8265f4600, server=jenkins-hbase4.apache.org,45923,1695031276292 in 173 msec 2023-09-18 10:02:27,699 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-18 10:02:27,700 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9323a89568527ac5842fa3f8265f4600, UNASSIGN in 180 msec 2023-09-18 10:02:27,700 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031347700"}]},"ts":"1695031347700"} 2023-09-18 10:02:27,701 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-18 10:02:27,704 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-18 10:02:27,706 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-09-18 10:02:27,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-18 10:02:27,817 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-18 10:02:27,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-18 10:02:27,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,821 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-18 10:02:27,822 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,825 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-18 10:02:27,828 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,828 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,828 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,828 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-18 10:02:27,829 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 2023-09-18 10:02:27,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-18 10:02:27,829 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:02:27,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-18 10:02:27,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:27,830 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:27,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-18 10:02:27,832 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/recovered.edits] 2023-09-18 10:02:27,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/recovered.edits] 2023-09-18 10:02:27,838 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf/3c1de505529f4290a69b1a0dfc2d6809 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/cf/3c1de505529f4290a69b1a0dfc2d6809 2023-09-18 10:02:27,838 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf/34f95c71b8df4fb7b8278d8a418e5a03 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/cf/34f95c71b8df4fb7b8278d8a418e5a03 2023-09-18 10:02:27,841 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600/recovered.edits/9.seqid 2023-09-18 10:02:27,841 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a/recovered.edits/9.seqid 2023-09-18 10:02:27,842 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/9323a89568527ac5842fa3f8265f4600 2023-09-18 10:02:27,842 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testConsecutiveExports/a2b19fbf7f369c8f29baec9c8697110a 2023-09-18 10:02:27,842 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-18 10:02:27,842 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-18 10:02:27,843 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-18 10:02:27,846 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230918a5c55f8847d540daa2f6e7763895ace5 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230918a5c55f8847d540daa2f6e7763895ace5 2023-09-18 10:02:27,847 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091899ad9932c63b4825ac07410f1b8783f2 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091899ad9932c63b4825ac07410f1b8783f2 2023-09-18 10:02:27,848 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-18 10:02:27,850 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,852 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-18 10:02:27,854 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-18 10:02:27,855 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,855 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-18 10:02:27,855 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031347855"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:27,855 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031347855"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:27,857 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-18 10:02:27,857 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a2b19fbf7f369c8f29baec9c8697110a, NAME => 'testtb-testConsecutiveExports,,1695031318024.a2b19fbf7f369c8f29baec9c8697110a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9323a89568527ac5842fa3f8265f4600, NAME => 'testtb-testConsecutiveExports,1,1695031318024.9323a89568527ac5842fa3f8265f4600.', STARTKEY => '1', ENDKEY => ''}] 2023-09-18 10:02:27,857 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-18 10:02:27,857 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031347857"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:27,859 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-18 10:02:27,862 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-18 10:02:27,863 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 44 msec 2023-09-18 10:02:27,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-18 10:02:27,933 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-18 10:02:27,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-18 10:02:27,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-18 10:02:27,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-18 10:02:27,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-18 10:02:27,970 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=751 (was 765), OpenFileDescriptor=907 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=247 (was 227) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=8059 (was 8211) 2023-09-18 10:02:27,970 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-09-18 10:02:27,989 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=750, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=247, ProcessCount=167, AvailableMemoryMB=8058 2023-09-18 10:02:27,989 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=750 is superior to 500 2023-09-18 10:02:27,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-18 10:02:27,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:27,994 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:02:27,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-18 10:02:27,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:02:27,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-18 10:02:27,997 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:27,997 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:27,998 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba empty. 2023-09-18 10:02:27,998 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 empty. 2023-09-18 10:02:27,998 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:27,998 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:27,998 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-18 10:02:28,008 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-18 10:02:28,009 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 33b305364bde360f44d4412f0161f0ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:28,009 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 44b9867c9a8e846e6c5c54df6e7a5520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:28,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:28,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:28,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 33b305364bde360f44d4412f0161f0ba, disabling compactions & flushes 2023-09-18 10:02:28,018 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 44b9867c9a8e846e6c5c54df6e7a5520, disabling compactions & flushes 2023-09-18 10:02:28,018 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,019 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. after waiting 0 ms 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,019 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 33b305364bde360f44d4412f0161f0ba: 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. after waiting 0 ms 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,019 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,019 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 44b9867c9a8e846e6c5c54df6e7a5520: 2023-09-18 10:02:28,021 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:02:28,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031348022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031348022"}]},"ts":"1695031348022"} 2023-09-18 10:02:28,023 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031348022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031348022"}]},"ts":"1695031348022"} 2023-09-18 10:02:28,029 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:02:28,030 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:02:28,030 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031348030"}]},"ts":"1695031348030"} 2023-09-18 10:02:28,032 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-18 10:02:28,035 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:02:28,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:02:28,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:02:28,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:02:28,036 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:02:28,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, ASSIGN}] 2023-09-18 10:02:28,039 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, ASSIGN 2023-09-18 10:02:28,039 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, ASSIGN 2023-09-18 10:02:28,040 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33575,1695031276250; forceNewPlan=false, retain=false 2023-09-18 10:02:28,040 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:02:28,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-18 10:02:28,190 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:02:28,193 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=33b305364bde360f44d4412f0161f0ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,193 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=44b9867c9a8e846e6c5c54df6e7a5520, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,193 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031348193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031348193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031348193"}]},"ts":"1695031348193"} 2023-09-18 10:02:28,193 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031348193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031348193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031348193"}]},"ts":"1695031348193"} 2023-09-18 10:02:28,195 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 44b9867c9a8e846e6c5c54df6e7a5520, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:02:28,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 33b305364bde360f44d4412f0161f0ba, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:28,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-18 10:02:28,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33b305364bde360f44d4412f0161f0ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.', STARTKEY => '', ENDKEY => '1'} 2023-09-18 10:02:28,353 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44b9867c9a8e846e6c5c54df6e7a5520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.', STARTKEY => '1', ENDKEY => ''} 2023-09-18 10:02:28,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. service=AccessControlService 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. service=AccessControlService 2023-09-18 10:02:28,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:28,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,355 INFO [StoreOpener-33b305364bde360f44d4412f0161f0ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,355 INFO [StoreOpener-44b9867c9a8e846e6c5c54df6e7a5520-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,357 DEBUG [StoreOpener-33b305364bde360f44d4412f0161f0ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf 2023-09-18 10:02:28,357 DEBUG [StoreOpener-33b305364bde360f44d4412f0161f0ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf 2023-09-18 10:02:28,357 DEBUG [StoreOpener-44b9867c9a8e846e6c5c54df6e7a5520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf 2023-09-18 10:02:28,357 DEBUG [StoreOpener-44b9867c9a8e846e6c5c54df6e7a5520-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf 2023-09-18 10:02:28,358 INFO [StoreOpener-33b305364bde360f44d4412f0161f0ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33b305364bde360f44d4412f0161f0ba columnFamilyName cf 2023-09-18 10:02:28,358 INFO [StoreOpener-44b9867c9a8e846e6c5c54df6e7a5520-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44b9867c9a8e846e6c5c54df6e7a5520 columnFamilyName cf 2023-09-18 10:02:28,360 INFO [StoreOpener-44b9867c9a8e846e6c5c54df6e7a5520-1] regionserver.HStore(310): Store=44b9867c9a8e846e6c5c54df6e7a5520/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:28,360 INFO [StoreOpener-33b305364bde360f44d4412f0161f0ba-1] regionserver.HStore(310): Store=33b305364bde360f44d4412f0161f0ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:28,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:28,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:28,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:28,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:28,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33b305364bde360f44d4412f0161f0ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60262328, jitterRate=-0.10202133655548096}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:28,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33b305364bde360f44d4412f0161f0ba: 2023-09-18 10:02:28,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44b9867c9a8e846e6c5c54df6e7a5520; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61822100, jitterRate=-0.07877892255783081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:28,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44b9867c9a8e846e6c5c54df6e7a5520: 2023-09-18 10:02:28,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba., pid=61, masterSystemTime=1695031348347 2023-09-18 10:02:28,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520., pid=60, masterSystemTime=1695031348347 2023-09-18 10:02:28,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,370 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=33b305364bde360f44d4412f0161f0ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,370 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031348370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031348370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031348370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031348370"}]},"ts":"1695031348370"} 2023-09-18 10:02:28,370 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=44b9867c9a8e846e6c5c54df6e7a5520, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,371 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031348370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031348370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031348370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031348370"}]},"ts":"1695031348370"} 2023-09-18 10:02:28,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-18 10:02:28,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 33b305364bde360f44d4412f0161f0ba, server=jenkins-hbase4.apache.org,45923,1695031276292 in 176 msec 2023-09-18 10:02:28,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-18 10:02:28,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 44b9867c9a8e846e6c5c54df6e7a5520, server=jenkins-hbase4.apache.org,33575,1695031276250 in 178 msec 2023-09-18 10:02:28,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, ASSIGN in 338 msec 2023-09-18 10:02:28,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-18 10:02:28,377 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, ASSIGN in 339 msec 2023-09-18 10:02:28,378 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:02:28,378 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031348378"}]},"ts":"1695031348378"} 2023-09-18 10:02:28,379 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-18 10:02:28,381 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:02:28,382 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-18 10:02:28,383 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-18 10:02:28,386 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:28,386 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:28,386 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:28,386 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:28,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:28,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:28,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:28,388 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:28,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 397 msec 2023-09-18 10:02:28,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-18 10:02:28,599 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-18 10:02:28,602 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,602 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,605 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:02:28,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-18 10:02:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031348617 (current time:1695031348617). 2023-09-18 10:02:28,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:28,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x1478d7ee to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:28,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293bc37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:28,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:28,629 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:28,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1478d7ee to 127.0.0.1:57492 2023-09-18 10:02:28,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:28,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x7d1b5489 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:28,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0e2b63, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:28,638 DEBUG [hconnection-0x30e358b1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:28,639 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:28,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:28,645 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:28,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d1b5489 to 127.0.0.1:57492 2023-09-18 10:02:28,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:28,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-18 10:02:28,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:28,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-18 10:02:28,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-18 10:02:28,651 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-18 10:02:28,651 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695031948651 2023-09-18 10:02:28,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-18 10:02:28,652 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:28,653 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:28,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-18 10:02:28,653 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-18 10:02:28,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-18 10:02:28,655 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-18 10:02:28,656 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695031948656 2023-09-18 10:02:28,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,668 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-18 10:02:28,668 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:28,669 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-18 10:02:28,669 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-18 10:02:28,669 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,669 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,670 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:28,670 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:28,670 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:28,670 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:28,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:28,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:28,671 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,671 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,672 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,672 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,673 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-18 10:02:28,673 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-18 10:02:28,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-18 10:02:28,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-18 10:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-18 10:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:28,674 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-18 10:02:28,673 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-18 10:02:28,675 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-18 10:02:28,676 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-18 10:02:28,677 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,678 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,678 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:28,679 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,679 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 1] remaining members to acquire global barrier 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:28,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:28,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-18 10:02:28,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e694e37[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:28,684 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-18 10:02:28,684 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-18 10:02:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-18 10:02:28,685 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,685 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:28,686 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:28,686 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:28,686 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-18 10:02:28,686 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. started... 2023-09-18 10:02:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-18 10:02:28,686 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:28,686 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44b9867c9a8e846e6c5c54df6e7a5520: 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. started... 2023-09-18 10:02:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33b305364bde360f44d4412f0161f0ba: 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:28,687 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:02:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-18 10:02:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-18 10:02:28,702 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. completed. 2023-09-18 10:02:28,702 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-18 10:02:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:28,703 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. completed. 2023-09-18 10:02:28,703 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-18 10:02:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:28,704 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-18 10:02:28,704 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,704 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:28,704 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-18 10:02:28,706 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,707 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-18 10:02:28,707 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:28,707 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-18 10:02:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33575,1695031276250': 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:28,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-18 10:02:28,714 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-18 10:02:28,714 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:28,714 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:28,714 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,714 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:28,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,716 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:28,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:28,717 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:28,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:28,717 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,718 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:28,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:28,720 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,720 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,720 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:28,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:28,724 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:28,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:28,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:28,726 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:28,724 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:28,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:28,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:28,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:28,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:28,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:02:28,726 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,727 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:28,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:28,727 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,727 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:28,727 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:28,727 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,727 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-18 10:02:28,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,753 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:28,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-18 10:02:28,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:02:28,754 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:02:28,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,755 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-18 10:02:28,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,756 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695031348651Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695031348736 (+85 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695031348736Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695031348736Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695031348739 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695031348749 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695031348755 (+6 ms) 2023-09-18 10:02:28,758 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-18 10:02:28,760 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 107 msec 2023-09-18 10:02:28,954 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:28,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-18 10:02:28,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:28,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:02:28,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33575] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:02:28,961 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:28,961 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:28,961 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:02:28,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-18 10:02:28,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031348971 (current time:1695031348971). 2023-09-18 10:02:28,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:28,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x08bd75a3 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:28,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416325d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:28,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:28,983 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:28,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08bd75a3 to 127.0.0.1:57492 2023-09-18 10:02:28,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:28,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x4423a4aa to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:28,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2750c1e0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:28,991 DEBUG [hconnection-0x7fc53d7f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:28,994 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:28,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:28,999 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:29,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4423a4aa to 127.0.0.1:57492 2023-09-18 10:02:29,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:29,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-18 10:02:29,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-18 10:02:29,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-18 10:02:29,004 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-18 10:02:29,005 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695031949005 2023-09-18 10:02:29,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-18 10:02:29,005 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,006 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:29,006 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:29,007 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-18 10:02:29,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-18 10:02:29,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-18 10:02:29,009 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-18 10:02:29,010 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695031949010 2023-09-18 10:02:29,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,018 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-18 10:02:29,018 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:29,019 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-18 10:02:29,019 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-18 10:02:29,020 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,020 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:29,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:29,021 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,021 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:29,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:29,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,021 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,021 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,022 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-18 10:02:29,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,023 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-18 10:02:29,023 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:29,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-18 10:02:29,024 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-18 10:02:29,024 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-18 10:02:29,024 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-18 10:02:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-18 10:02:29,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,024 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-18 10:02:29,024 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:29,025 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-18 10:02:29,025 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-18 10:02:29,025 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-18 10:02:29,025 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-18 10:02:29,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,025 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-18 10:02:29,025 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:29,026 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-18 10:02:29,026 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-18 10:02:29,026 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-18 10:02:29,027 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,027 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:29,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:29,028 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,028 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:29,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,030 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:29,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:29,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:29,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-18 10:02:29,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 1] remaining members to acquire global barrier 2023-09-18 10:02:29,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:29,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-18 10:02:29,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5109fa94[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:29,033 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-18 10:02:29,033 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,034 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,034 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-18 10:02:29,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:29,035 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:29,035 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,035 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:29,035 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-18 10:02:29,035 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. started... 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:29,035 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. started... 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:29,036 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:29,035 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:29,036 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 44b9867c9a8e846e6c5c54df6e7a5520 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-18 10:02:29,036 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 33b305364bde360f44d4412f0161f0ba 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-18 10:02:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-18 10:02:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:29,037 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-18 10:02:29,057 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230918316c64a86ef147839e051cbe829fe610 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230918316c64a86ef147839e051cbe829fe610 2023-09-18 10:02:29,057 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230918abd533e2cbc647ff85d2371b3c08531f to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230918abd533e2cbc647ff85d2371b3c08531f 2023-09-18 10:02:29,064 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/.tmp/cf/35ae57a180f3461081e1f06398359a19 2023-09-18 10:02:29,064 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/.tmp/cf/20d928d9a3cb4439beaf772a3e88f5ea 2023-09-18 10:02:29,069 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/.tmp/cf/35ae57a180f3461081e1f06398359a19 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf/35ae57a180f3461081e1f06398359a19 2023-09-18 10:02:29,069 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/.tmp/cf/20d928d9a3cb4439beaf772a3e88f5ea as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf/20d928d9a3cb4439beaf772a3e88f5ea 2023-09-18 10:02:29,074 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf/35ae57a180f3461081e1f06398359a19, entries=46, sequenceid=6, filesize=13.3 K 2023-09-18 10:02:29,074 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf/20d928d9a3cb4439beaf772a3e88f5ea, entries=4, sequenceid=6, filesize=5.6 K 2023-09-18 10:02:29,074 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 33b305364bde360f44d4412f0161f0ba in 38ms, sequenceid=6, compaction requested=false 2023-09-18 10:02:29,075 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 44b9867c9a8e846e6c5c54df6e7a5520 in 39ms, sequenceid=6, compaction requested=false 2023-09-18 10:02:29,075 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-18 10:02:29,075 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-18 10:02:29,077 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33b305364bde360f44d4412f0161f0ba: 2023-09-18 10:02:29,077 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 44b9867c9a8e846e6c5c54df6e7a5520: 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf/20d928d9a3cb4439beaf772a3e88f5ea] hfiles 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf/35ae57a180f3461081e1f06398359a19] hfiles 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf/20d928d9a3cb4439beaf772a3e88f5ea for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,078 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf/35ae57a180f3461081e1f06398359a19 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,085 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. completed. 2023-09-18 10:02:29,085 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:29,085 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. completed. 2023-09-18 10:02:29,085 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:29,085 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:29,088 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,088 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-18 10:02:29,088 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:29,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:29,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:29,088 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-18 10:02:29,089 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-18 10:02:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:29,090 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-18 10:02:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:29,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33575,1695031276250': 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:29,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:29,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-18 10:02:29,097 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-18 10:02:29,097 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:29,098 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:29,098 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,098 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:29,103 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:29,103 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:29,104 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,104 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:29,106 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,106 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,106 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:29,107 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-18 10:02:29,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:02:29,108 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:29,110 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:29,110 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,110 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:29,111 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:29,111 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,111 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:29,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:29,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:29,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:02:29,111 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:29,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:29,112 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:29,112 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:29,112 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:29,112 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230918316c64a86ef147839e051cbe829fe610, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230918abd533e2cbc647ff85d2371b3c08531f] mob files 2023-09-18 10:02:29,113 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230918316c64a86ef147839e051cbe829fe610 2023-09-18 10:02:29,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230918abd533e2cbc647ff85d2371b3c08531f 2023-09-18 10:02:29,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,120 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,137 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,138 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-18 10:02:29,138 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,138 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:29,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695031349005Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695031349120 (+115 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695031349120Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695031349120Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695031349123 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695031349130 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695031349138 (+8 ms) 2023-09-18 10:02:29,141 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-18 10:02:29,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 135 msec 2023-09-18 10:02:29,308 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:29,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-18 10:02:29,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:29,339 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-18 10:02:29,342 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41444, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-18 10:02:29,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33575] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-18 10:02:29,344 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-18 10:02:29,347 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-18 10:02:29,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34469] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-18 10:02:29,348 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-18 10:02:29,353 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-18 10:02:29,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-18 10:02:29,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-18 10:02:29,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:29,358 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:02:29,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-18 10:02:29,359 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:02:29,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-18 10:02:29,361 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,361 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 2023-09-18 10:02:29,362 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc empty. 2023-09-18 10:02:29,362 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 empty. 2023-09-18 10:02:29,362 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,362 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 2023-09-18 10:02:29,363 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-18 10:02:29,372 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-18 10:02:29,373 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 26f2871d0760b71db6adcb4787e067fc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:29,374 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 679b356e16325a4266975308a8515568, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:29,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:29,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 679b356e16325a4266975308a8515568, disabling compactions & flushes 2023-09-18 10:02:29,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. after waiting 0 ms 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 679b356e16325a4266975308a8515568: 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 26f2871d0760b71db6adcb4787e067fc, disabling compactions & flushes 2023-09-18 10:02:29,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. after waiting 0 ms 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 26f2871d0760b71db6adcb4787e067fc: 2023-09-18 10:02:29,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:02:29,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031349387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031349387"}]},"ts":"1695031349387"} 2023-09-18 10:02:29,387 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031349387"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031349387"}]},"ts":"1695031349387"} 2023-09-18 10:02:29,390 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:02:29,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:02:29,391 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031349391"}]},"ts":"1695031349391"} 2023-09-18 10:02:29,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-18 10:02:29,395 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:02:29,396 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:02:29,396 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:02:29,396 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:02:29,396 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:02:29,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, ASSIGN}] 2023-09-18 10:02:29,400 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, ASSIGN 2023-09-18 10:02:29,400 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, ASSIGN 2023-09-18 10:02:29,401 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34469,1695031276191; forceNewPlan=false, retain=false 2023-09-18 10:02:29,401 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:02:29,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-18 10:02:29,551 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:02:29,554 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=679b356e16325a4266975308a8515568, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,554 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=26f2871d0760b71db6adcb4787e067fc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,555 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031349554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031349554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031349554"}]},"ts":"1695031349554"} 2023-09-18 10:02:29,555 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031349554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031349554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031349554"}]},"ts":"1695031349554"} 2023-09-18 10:02:29,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 679b356e16325a4266975308a8515568, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:02:29,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 26f2871d0760b71db6adcb4787e067fc, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:29,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-18 10:02:29,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26f2871d0760b71db6adcb4787e067fc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.', STARTKEY => '', ENDKEY => '2'} 2023-09-18 10:02:29,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 679b356e16325a4266975308a8515568, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.', STARTKEY => '2', ENDKEY => ''} 2023-09-18 10:02:29,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. service=AccessControlService 2023-09-18 10:02:29,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. service=AccessControlService 2023-09-18 10:02:29,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:29,713 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 679b356e16325a4266975308a8515568 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 679b356e16325a4266975308a8515568 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 679b356e16325a4266975308a8515568 2023-09-18 10:02:29,714 INFO [StoreOpener-679b356e16325a4266975308a8515568-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 679b356e16325a4266975308a8515568 2023-09-18 10:02:29,714 INFO [StoreOpener-26f2871d0760b71db6adcb4787e067fc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,716 DEBUG [StoreOpener-679b356e16325a4266975308a8515568-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf 2023-09-18 10:02:29,716 DEBUG [StoreOpener-26f2871d0760b71db6adcb4787e067fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf 2023-09-18 10:02:29,716 DEBUG [StoreOpener-679b356e16325a4266975308a8515568-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf 2023-09-18 10:02:29,716 DEBUG [StoreOpener-26f2871d0760b71db6adcb4787e067fc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf 2023-09-18 10:02:29,716 INFO [StoreOpener-26f2871d0760b71db6adcb4787e067fc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26f2871d0760b71db6adcb4787e067fc columnFamilyName cf 2023-09-18 10:02:29,716 INFO [StoreOpener-679b356e16325a4266975308a8515568-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 679b356e16325a4266975308a8515568 columnFamilyName cf 2023-09-18 10:02:29,717 INFO [StoreOpener-26f2871d0760b71db6adcb4787e067fc-1] regionserver.HStore(310): Store=26f2871d0760b71db6adcb4787e067fc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:29,717 INFO [StoreOpener-679b356e16325a4266975308a8515568-1] regionserver.HStore(310): Store=679b356e16325a4266975308a8515568/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 2023-09-18 10:02:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 2023-09-18 10:02:29,718 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 679b356e16325a4266975308a8515568 2023-09-18 10:02:29,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:29,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:29,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 679b356e16325a4266975308a8515568; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66697261, jitterRate=-0.006133362650871277}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 679b356e16325a4266975308a8515568: 2023-09-18 10:02:29,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 26f2871d0760b71db6adcb4787e067fc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66213430, jitterRate=-0.013343006372451782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:29,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 26f2871d0760b71db6adcb4787e067fc: 2023-09-18 10:02:29,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568., pid=69, masterSystemTime=1695031349708 2023-09-18 10:02:29,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc., pid=70, masterSystemTime=1695031349708 2023-09-18 10:02:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:29,730 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=679b356e16325a4266975308a8515568, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:29,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,730 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:29,730 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031349730"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031349730"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031349730"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031349730"}]},"ts":"1695031349730"} 2023-09-18 10:02:29,730 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=26f2871d0760b71db6adcb4787e067fc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:29,730 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031349730"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031349730"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031349730"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031349730"}]},"ts":"1695031349730"} 2023-09-18 10:02:29,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-18 10:02:29,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 679b356e16325a4266975308a8515568, server=jenkins-hbase4.apache.org,34469,1695031276191 in 175 msec 2023-09-18 10:02:29,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-18 10:02:29,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 26f2871d0760b71db6adcb4787e067fc, server=jenkins-hbase4.apache.org,45923,1695031276292 in 175 msec 2023-09-18 10:02:29,734 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, ASSIGN in 336 msec 2023-09-18 10:02:29,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-18 10:02:29,735 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, ASSIGN in 337 msec 2023-09-18 10:02:29,736 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:02:29,736 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031349736"}]},"ts":"1695031349736"} 2023-09-18 10:02:29,737 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-18 10:02:29,740 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:02:29,741 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-18 10:02:29,742 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-18 10:02:29,744 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:29,744 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:29,744 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:29,744 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,746 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:29,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 389 msec 2023-09-18 10:02:29,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-18 10:02:29,963 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-18 10:02:29,986 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 26f2871d0760b71db6adcb4787e067fc, 679b356e16325a4266975308a8515568 2023-09-18 10:02:29,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[26f2871d0760b71db6adcb4787e067fc, 679b356e16325a4266975308a8515568], force=true 2023-09-18 10:02:29,997 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[26f2871d0760b71db6adcb4787e067fc, 679b356e16325a4266975308a8515568], force=true 2023-09-18 10:02:29,997 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[26f2871d0760b71db6adcb4787e067fc, 679b356e16325a4266975308a8515568], force=true 2023-09-18 10:02:29,997 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[26f2871d0760b71db6adcb4787e067fc, 679b356e16325a4266975308a8515568], force=true 2023-09-18 10:02:29,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-18 10:02:30,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, UNASSIGN}] 2023-09-18 10:02:30,020 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, UNASSIGN 2023-09-18 10:02:30,020 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, UNASSIGN 2023-09-18 10:02:30,020 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=26f2871d0760b71db6adcb4787e067fc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:30,021 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=679b356e16325a4266975308a8515568, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:30,021 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031350020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031350020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031350020"}]},"ts":"1695031350020"} 2023-09-18 10:02:30,021 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031350020"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031350020"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031350020"}]},"ts":"1695031350020"} 2023-09-18 10:02:30,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 26f2871d0760b71db6adcb4787e067fc, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:30,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 679b356e16325a4266975308a8515568, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:02:30,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-18 10:02:30,137 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-18 10:02:30,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:30,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 679b356e16325a4266975308a8515568 2023-09-18 10:02:30,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 26f2871d0760b71db6adcb4787e067fc, disabling compactions & flushes 2023-09-18 10:02:30,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 679b356e16325a4266975308a8515568, disabling compactions & flushes 2023-09-18 10:02:30,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:30,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:30,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:30,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:30,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. after waiting 0 ms 2023-09-18 10:02:30,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:30,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. after waiting 0 ms 2023-09-18 10:02:30,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:30,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 679b356e16325a4266975308a8515568 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-18 10:02:30,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 26f2871d0760b71db6adcb4787e067fc 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-18 10:02:30,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/.tmp/cf/00d0c67067d54e0e88f85867aec60cd7 2023-09-18 10:02:30,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/.tmp/cf/57b3c25ebf0e40149e3fa10c2a454643 2023-09-18 10:02:30,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/.tmp/cf/00d0c67067d54e0e88f85867aec60cd7 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf/00d0c67067d54e0e88f85867aec60cd7 2023-09-18 10:02:30,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/.tmp/cf/57b3c25ebf0e40149e3fa10c2a454643 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf/57b3c25ebf0e40149e3fa10c2a454643 2023-09-18 10:02:30,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf/00d0c67067d54e0e88f85867aec60cd7, entries=1, sequenceid=5, filesize=4.7 K 2023-09-18 10:02:30,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 679b356e16325a4266975308a8515568 in 28ms, sequenceid=5, compaction requested=false 2023-09-18 10:02:30,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf/57b3c25ebf0e40149e3fa10c2a454643, entries=1, sequenceid=5, filesize=4.7 K 2023-09-18 10:02:30,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 26f2871d0760b71db6adcb4787e067fc in 33ms, sequenceid=5, compaction requested=false 2023-09-18 10:02:30,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-18 10:02:30,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:30,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568. 2023-09-18 10:02:30,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 679b356e16325a4266975308a8515568: 2023-09-18 10:02:30,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-18 10:02:30,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:30,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc. 2023-09-18 10:02:30,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 26f2871d0760b71db6adcb4787e067fc: 2023-09-18 10:02:30,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 679b356e16325a4266975308a8515568 2023-09-18 10:02:30,219 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=679b356e16325a4266975308a8515568, regionState=CLOSED 2023-09-18 10:02:30,219 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031350219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031350219"}]},"ts":"1695031350219"} 2023-09-18 10:02:30,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:30,220 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=26f2871d0760b71db6adcb4787e067fc, regionState=CLOSED 2023-09-18 10:02:30,220 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695031350220"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031350220"}]},"ts":"1695031350220"} 2023-09-18 10:02:30,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-18 10:02:30,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 679b356e16325a4266975308a8515568, server=jenkins-hbase4.apache.org,34469,1695031276191 in 197 msec 2023-09-18 10:02:30,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-18 10:02:30,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 26f2871d0760b71db6adcb4787e067fc, server=jenkins-hbase4.apache.org,45923,1695031276292 in 199 msec 2023-09-18 10:02:30,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=679b356e16325a4266975308a8515568, UNASSIGN in 204 msec 2023-09-18 10:02:30,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-18 10:02:30,224 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=26f2871d0760b71db6adcb4787e067fc, UNASSIGN in 208 msec 2023-09-18 10:02:30,273 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-18 10:02:30,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349355.26f2871d0760b71db6adcb4787e067fc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:30,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695031349355.679b356e16325a4266975308a8515568.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:30,275 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:30,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-18 10:02:30,325 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, ASSIGN}] 2023-09-18 10:02:30,326 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, ASSIGN 2023-09-18 10:02:30,326 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:02:30,477 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-18 10:02:30,479 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4937db55d36c12cb8ae879c593d06fbc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:30,479 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695031350479"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031350479"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031350479"}]},"ts":"1695031350479"} 2023-09-18 10:02:30,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4937db55d36c12cb8ae879c593d06fbc, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:30,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-18 10:02:30,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:30,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4937db55d36c12cb8ae879c593d06fbc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.', STARTKEY => '', ENDKEY => ''} 2023-09-18 10:02:30,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. service=AccessControlService 2023-09-18 10:02:30,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:30,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:30,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/.regioninfo 2023-09-18 10:02:30,647 INFO [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,648 DEBUG [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf 2023-09-18 10:02:30,648 DEBUG [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf 2023-09-18 10:02:30,648 INFO [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4937db55d36c12cb8ae879c593d06fbc columnFamilyName cf 2023-09-18 10:02:30,676 DEBUG [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] regionserver.HStore(539): loaded hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/00d0c67067d54e0e88f85867aec60cd7.679b356e16325a4266975308a8515568->hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf/00d0c67067d54e0e88f85867aec60cd7-top 2023-09-18 10:02:30,681 DEBUG [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] regionserver.HStore(539): loaded hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/57b3c25ebf0e40149e3fa10c2a454643.26f2871d0760b71db6adcb4787e067fc->hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf/57b3c25ebf0e40149e3fa10c2a454643-top 2023-09-18 10:02:30,682 INFO [StoreOpener-4937db55d36c12cb8ae879c593d06fbc-1] regionserver.HStore(310): Store=4937db55d36c12cb8ae879c593d06fbc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:30,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:30,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4937db55d36c12cb8ae879c593d06fbc; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61166741, jitterRate=-0.08854453265666962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:30,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4937db55d36c12cb8ae879c593d06fbc: 2023-09-18 10:02:30,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc., pid=77, masterSystemTime=1695031350632 2023-09-18 10:02:30,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.,because compaction is disabled. 2023-09-18 10:02:30,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:30,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:30,690 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4937db55d36c12cb8ae879c593d06fbc, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:30,691 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695031350690"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031350690"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031350690"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031350690"}]},"ts":"1695031350690"} 2023-09-18 10:02:30,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-18 10:02:30,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4937db55d36c12cb8ae879c593d06fbc, server=jenkins-hbase4.apache.org,45923,1695031276292 in 211 msec 2023-09-18 10:02:30,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-18 10:02:30,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, ASSIGN in 368 msec 2023-09-18 10:02:30,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[26f2871d0760b71db6adcb4787e067fc, 679b356e16325a4266975308a8515568], force=true in 705 msec 2023-09-18 10:02:31,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-18 10:02:31,104 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-18 10:02:31,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-18 10:02:31,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031351105 (current time:1695031351105). 2023-09-18 10:02:31,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:31,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x56f4c71d to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:31,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e7b31c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:31,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:31,116 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:31,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56f4c71d to 127.0.0.1:57492 2023-09-18 10:02:31,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:31,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x4f6b6a59 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:31,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f578086, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:31,125 DEBUG [hconnection-0x68f573b9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:31,127 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:31,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:31,133 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:31,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f6b6a59 to 127.0.0.1:57492 2023-09-18 10:02:31,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:31,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-18 10:02:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:31,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-18 10:02:31,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-18 10:02:31,138 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-18 10:02:31,139 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695031951139 2023-09-18 10:02:31,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-18 10:02:31,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,142 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:31,142 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:31,143 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-18 10:02:31,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-18 10:02:31,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-18 10:02:31,145 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-18 10:02:31,146 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695031951146 2023-09-18 10:02:31,154 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,155 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-18 10:02:31,155 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:31,156 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-18 10:02:31,156 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-18 10:02:31,156 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,156 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,157 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:31,157 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:31,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:31,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:31,157 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,157 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:31,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,158 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,158 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-18 10:02:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-18 10:02:31,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:31,160 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-18 10:02:31,160 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-18 10:02:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-18 10:02:31,159 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-18 10:02:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-18 10:02:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-18 10:02:31,161 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-18 10:02:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-18 10:02:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-18 10:02:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-18 10:02:31,164 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,165 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:31,167 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-18 10:02:31,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45338cb3[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:31,168 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-18 10:02:31,168 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-18 10:02:31,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-18 10:02:31,171 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:31,170 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-18 10:02:31,171 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. started... 2023-09-18 10:02:31,170 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,171 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-18 10:02:31,172 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:31,171 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-18 10:02:31,172 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4937db55d36c12cb8ae879c593d06fbc: 2023-09-18 10:02:31,172 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:31,172 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,172 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:31,172 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/00d0c67067d54e0e88f85867aec60cd7.679b356e16325a4266975308a8515568->hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf/00d0c67067d54e0e88f85867aec60cd7-top, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/57b3c25ebf0e40149e3fa10c2a454643.26f2871d0760b71db6adcb4787e067fc->hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf/57b3c25ebf0e40149e3fa10c2a454643-top] hfiles 2023-09-18 10:02:31,172 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/00d0c67067d54e0e88f85867aec60cd7.679b356e16325a4266975308a8515568 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,173 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/57b3c25ebf0e40149e3fa10c2a454643.26f2871d0760b71db6adcb4787e067fc for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-18 10:02:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:31,173 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-18 10:02:31,175 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-18 10:02:31,175 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:31,175 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-18 10:02:31,185 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. completed. 2023-09-18 10:02:31,185 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:31,185 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:31,185 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:31,185 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,185 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-18 10:02:31,185 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:31,194 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-18 10:02:31,194 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,194 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:31,194 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-18 10:02:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:31,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-18 10:02:31,197 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-18 10:02:31,198 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:31,198 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:31,198 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,198 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:31,199 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,199 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:31,199 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:31,199 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,199 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:31,200 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:31,200 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:31,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:31,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:31,200 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,201 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:31,203 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,203 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,203 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:31,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,206 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:31,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,206 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:31,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:31,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,207 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-18 10:02:31,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,227 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695031351139Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695031351207 (+68 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695031351207Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695031351210 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695031351217 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695031351226 (+9 ms) 2023-09-18 10:02:31,229 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-18 10:02:31,231 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 87 msec 2023-09-18 10:02:31,242 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:31,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-18 10:02:31,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:31,243 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243 2023-09-18 10:02:31,244 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44901, tgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243, rawTgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:31,266 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:31,266 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1492856065_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,266 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-18 10:02:31,275 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:31,297 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:31,297 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:31,298 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:31,298 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,172 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-3834929397748174249.jar 2023-09-18 10:02:32,172 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,173 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,239 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-8805191045046623423.jar 2023-09-18 10:02:32,240 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,240 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,241 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,241 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,242 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,242 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:32,242 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:02:32,243 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:02:32,243 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:02:32,244 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:02:32,244 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:02:32,245 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:02:32,245 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:02:32,245 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:02:32,245 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:02:32,246 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:02:32,247 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:32,247 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:32,247 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:32,248 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:32,248 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:32,248 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:32,249 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:32,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0004_000001 (auth:SIMPLE) 2023-09-18 10:02:32,659 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:02:32,661 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-18 10:02:32,663 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-18 10:02:32,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:32,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:33,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:02:33,376 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0005_000001 (auth:SIMPLE) 2023-09-18 10:02:37,168 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0005_000001 (auth:SIMPLE) 2023-09-18 10:02:39,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0005_000001 (auth:SIMPLE) 2023-09-18 10:02:41,768 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0005_000001 (auth:SIMPLE) 2023-09-18 10:02:42,830 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:02:42,833 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:02:42,841 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:42,841 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:02:42,842 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:02:42,842 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:42,843 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-18 10:02:42,843 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-18 10:02:42,843 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:42,843 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-18 10:02:42,843 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031351243/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-18 10:02:42,850 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:42,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:42,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:42,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-18 10:02:42,854 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031362854"}]},"ts":"1695031362854"} 2023-09-18 10:02:42,856 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-18 10:02:42,857 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-18 10:02:42,858 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, UNASSIGN}] 2023-09-18 10:02:42,860 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, UNASSIGN 2023-09-18 10:02:42,861 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4937db55d36c12cb8ae879c593d06fbc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:42,861 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695031362861"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031362861"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031362861"}]},"ts":"1695031362861"} 2023-09-18 10:02:42,862 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4937db55d36c12cb8ae879c593d06fbc, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:42,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-18 10:02:43,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4937db55d36c12cb8ae879c593d06fbc, disabling compactions & flushes 2023-09-18 10:02:43,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. after waiting 0 ms 2023-09-18 10:02:43,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:43,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-18 10:02:43,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:43,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc. 2023-09-18 10:02:43,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4937db55d36c12cb8ae879c593d06fbc: 2023-09-18 10:02:43,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:43,029 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4937db55d36c12cb8ae879c593d06fbc, regionState=CLOSED 2023-09-18 10:02:43,029 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695031363029"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031363029"}]},"ts":"1695031363029"} 2023-09-18 10:02:43,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-18 10:02:43,031 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4937db55d36c12cb8ae879c593d06fbc, server=jenkins-hbase4.apache.org,45923,1695031276292 in 168 msec 2023-09-18 10:02:43,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-18 10:02:43,033 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4937db55d36c12cb8ae879c593d06fbc, UNASSIGN in 173 msec 2023-09-18 10:02:43,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031363033"}]},"ts":"1695031363033"} 2023-09-18 10:02:43,035 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-18 10:02:43,036 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-18 10:02:43,038 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-18 10:02:43,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-18 10:02:43,157 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-18 10:02:43,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,161 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,162 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,163 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,166 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 2023-09-18 10:02:43,166 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:43,166 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,166 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,166 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,166 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:43,166 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-18 10:02:43,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-18 10:02:43,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-18 10:02:43,167 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,167 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-18 10:02:43,167 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,168 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-18 10:02:43,167 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,168 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,167 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,168 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,168 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/recovered.edits] 2023-09-18 10:02:43,168 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/recovered.edits] 2023-09-18 10:02:43,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:43,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-18 10:02:43,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:43,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:43,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:43,169 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/recovered.edits] 2023-09-18 10:02:43,173 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/00d0c67067d54e0e88f85867aec60cd7.679b356e16325a4266975308a8515568 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/00d0c67067d54e0e88f85867aec60cd7.679b356e16325a4266975308a8515568 2023-09-18 10:02:43,173 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf/00d0c67067d54e0e88f85867aec60cd7 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/cf/00d0c67067d54e0e88f85867aec60cd7 2023-09-18 10:02:43,174 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf/57b3c25ebf0e40149e3fa10c2a454643 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/cf/57b3c25ebf0e40149e3fa10c2a454643 2023-09-18 10:02:43,174 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/57b3c25ebf0e40149e3fa10c2a454643.26f2871d0760b71db6adcb4787e067fc to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/cf/57b3c25ebf0e40149e3fa10c2a454643.26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:43,177 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/recovered.edits/8.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568/recovered.edits/8.seqid 2023-09-18 10:02:43,177 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/recovered.edits/8.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc/recovered.edits/8.seqid 2023-09-18 10:02:43,177 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/679b356e16325a4266975308a8515568 2023-09-18 10:02:43,178 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/26f2871d0760b71db6adcb4787e067fc 2023-09-18 10:02:43,178 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/recovered.edits/12.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc/recovered.edits/12.seqid 2023-09-18 10:02:43,178 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4937db55d36c12cb8ae879c593d06fbc 2023-09-18 10:02:43,178 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-18 10:02:43,180 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,182 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-18 10:02:43,184 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-18 10:02:43,185 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,185 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-18 10:02:43,186 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031363185"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:43,187 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-18 10:02:43,187 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4937db55d36c12cb8ae879c593d06fbc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695031349356.4937db55d36c12cb8ae879c593d06fbc.', STARTKEY => '', ENDKEY => ''}] 2023-09-18 10:02:43,187 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-18 10:02:43,187 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031363187"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:43,191 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-18 10:02:43,193 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,194 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-09-18 10:02:43,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-18 10:02:43,270 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-18 10:02:43,271 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-18 10:02:43,276 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031363276"}]},"ts":"1695031363276"} 2023-09-18 10:02:43,277 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-18 10:02:43,279 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-18 10:02:43,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, UNASSIGN}] 2023-09-18 10:02:43,281 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, UNASSIGN 2023-09-18 10:02:43,281 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, UNASSIGN 2023-09-18 10:02:43,282 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=33b305364bde360f44d4412f0161f0ba, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:43,282 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=44b9867c9a8e846e6c5c54df6e7a5520, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:43,282 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031363282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031363282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031363282"}]},"ts":"1695031363282"} 2023-09-18 10:02:43,282 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031363282"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031363282"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031363282"}]},"ts":"1695031363282"} 2023-09-18 10:02:43,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 33b305364bde360f44d4412f0161f0ba, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:43,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 44b9867c9a8e846e6c5c54df6e7a5520, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:02:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-18 10:02:43,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:43,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33b305364bde360f44d4412f0161f0ba, disabling compactions & flushes 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44b9867c9a8e846e6c5c54df6e7a5520, disabling compactions & flushes 2023-09-18 10:02:43,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:43,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. after waiting 0 ms 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. after waiting 0 ms 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:43,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:43,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:02:43,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:02:43,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:43,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba. 2023-09-18 10:02:43,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33b305364bde360f44d4412f0161f0ba: 2023-09-18 10:02:43,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:43,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520. 2023-09-18 10:02:43,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44b9867c9a8e846e6c5c54df6e7a5520: 2023-09-18 10:02:43,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:43,450 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=33b305364bde360f44d4412f0161f0ba, regionState=CLOSED 2023-09-18 10:02:43,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:43,450 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031363450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031363450"}]},"ts":"1695031363450"} 2023-09-18 10:02:43,451 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=44b9867c9a8e846e6c5c54df6e7a5520, regionState=CLOSED 2023-09-18 10:02:43,451 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695031363451"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031363451"}]},"ts":"1695031363451"} 2023-09-18 10:02:43,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-18 10:02:43,453 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 33b305364bde360f44d4412f0161f0ba, server=jenkins-hbase4.apache.org,45923,1695031276292 in 168 msec 2023-09-18 10:02:43,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-18 10:02:43,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 44b9867c9a8e846e6c5c54df6e7a5520, server=jenkins-hbase4.apache.org,33575,1695031276250 in 169 msec 2023-09-18 10:02:43,454 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=33b305364bde360f44d4412f0161f0ba, UNASSIGN in 174 msec 2023-09-18 10:02:43,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-18 10:02:43,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=44b9867c9a8e846e6c5c54df6e7a5520, UNASSIGN in 175 msec 2023-09-18 10:02:43,456 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031363456"}]},"ts":"1695031363456"} 2023-09-18 10:02:43,457 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-18 10:02:43,459 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-18 10:02:43,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 188 msec 2023-09-18 10:02:43,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-18 10:02:43,578 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-18 10:02:43,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,582 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,583 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,584 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,587 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,587 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,587 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,587 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-18 10:02:43,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-18 10:02:43,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-18 10:02:43,587 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-18 10:02:43,588 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:43,588 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:43,588 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,588 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,588 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,588 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,588 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,589 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,588 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,589 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:43,590 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/recovered.edits] 2023-09-18 10:02:43,590 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/recovered.edits] 2023-09-18 10:02:43,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-18 10:02:43,597 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf/20d928d9a3cb4439beaf772a3e88f5ea to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/cf/20d928d9a3cb4439beaf772a3e88f5ea 2023-09-18 10:02:43,597 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf/35ae57a180f3461081e1f06398359a19 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/cf/35ae57a180f3461081e1f06398359a19 2023-09-18 10:02:43,600 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba/recovered.edits/9.seqid 2023-09-18 10:02:43,600 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520/recovered.edits/9.seqid 2023-09-18 10:02:43,601 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/33b305364bde360f44d4412f0161f0ba 2023-09-18 10:02:43,601 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/44b9867c9a8e846e6c5c54df6e7a5520 2023-09-18 10:02:43,601 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-18 10:02:43,601 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-18 10:02:43,602 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-18 10:02:43,605 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230918316c64a86ef147839e051cbe829fe610 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230918316c64a86ef147839e051cbe829fe610 2023-09-18 10:02:43,607 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230918abd533e2cbc647ff85d2371b3c08531f to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230918abd533e2cbc647ff85d2371b3c08531f 2023-09-18 10:02:43,607 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-18 10:02:43,609 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,611 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-18 10:02:43,613 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-18 10:02:43,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-18 10:02:43,614 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031363614"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:43,614 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031363614"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:43,615 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-18 10:02:43,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 33b305364bde360f44d4412f0161f0ba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695031347990.33b305364bde360f44d4412f0161f0ba.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 44b9867c9a8e846e6c5c54df6e7a5520, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695031347990.44b9867c9a8e846e6c5c54df6e7a5520.', STARTKEY => '1', ENDKEY => ''}] 2023-09-18 10:02:43,616 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-18 10:02:43,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031363616"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:43,617 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-18 10:02:43,620 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 41 msec 2023-09-18 10:02:43,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-18 10:02:43,694 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-18 10:02:43,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-18 10:02:43,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-18 10:02:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-18 10:02:43,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-18 10:02:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-18 10:02:43,735 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1019527162_1 at /127.0.0.1:51696 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1019527162_1 at /127.0.0.1:51328 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:51348 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:43009 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x614d5738-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3957 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:51724 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 247), ProcessCount=167 (was 167), AvailableMemoryMB=7969 (was 8058) 2023-09-18 10:02:43,735 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-18 10:02:43,754 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=167, AvailableMemoryMB=7968 2023-09-18 10:02:43,755 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-18 10:02:43,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-18 10:02:43,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:43,759 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:02:43,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-18 10:02:43,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:02:43,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-18 10:02:43,762 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:43,762 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 2023-09-18 10:02:43,763 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef empty. 2023-09-18 10:02:43,763 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 empty. 2023-09-18 10:02:43,763 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:43,763 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 2023-09-18 10:02:43,763 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-18 10:02:43,772 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-18 10:02:43,773 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b59044b04d7760c1f607e19d9c7ebef, NAME => 'testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:43,774 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 136a229a757603f6def4b83aaff74007, NAME => 'testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8b59044b04d7760c1f607e19d9c7ebef, disabling compactions & flushes 2023-09-18 10:02:43,781 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. after waiting 0 ms 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 136a229a757603f6def4b83aaff74007, disabling compactions & flushes 2023-09-18 10:02:43,781 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:43,781 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8b59044b04d7760c1f607e19d9c7ebef: 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. after waiting 0 ms 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:43,781 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:43,781 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 136a229a757603f6def4b83aaff74007: 2023-09-18 10:02:43,783 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:02:43,784 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031363784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031363784"}]},"ts":"1695031363784"} 2023-09-18 10:02:43,784 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031363784"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031363784"}]},"ts":"1695031363784"} 2023-09-18 10:02:43,786 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:02:43,787 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:02:43,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031363787"}]},"ts":"1695031363787"} 2023-09-18 10:02:43,788 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-18 10:02:43,790 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:02:43,792 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:02:43,792 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:02:43,792 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:02:43,792 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:02:43,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, ASSIGN}] 2023-09-18 10:02:43,794 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, ASSIGN 2023-09-18 10:02:43,795 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, ASSIGN 2023-09-18 10:02:43,795 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:02:43,795 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34469,1695031276191; forceNewPlan=false, retain=false 2023-09-18 10:02:43,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-18 10:02:43,945 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:02:43,948 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8b59044b04d7760c1f607e19d9c7ebef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:43,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=136a229a757603f6def4b83aaff74007, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:43,949 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031363948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031363948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031363948"}]},"ts":"1695031363948"} 2023-09-18 10:02:43,949 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031363948"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031363948"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031363948"}]},"ts":"1695031363948"} 2023-09-18 10:02:43,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 8b59044b04d7760c1f607e19d9c7ebef, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:02:43,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 136a229a757603f6def4b83aaff74007, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:44,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-18 10:02:44,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 136a229a757603f6def4b83aaff74007, NAME => 'testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.', STARTKEY => '1', ENDKEY => ''} 2023-09-18 10:02:44,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. service=AccessControlService 2023-09-18 10:02:44,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b59044b04d7760c1f607e19d9c7ebef, NAME => 'testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.', STARTKEY => '', ENDKEY => '1'} 2023-09-18 10:02:44,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. service=AccessControlService 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,110 INFO [StoreOpener-136a229a757603f6def4b83aaff74007-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,110 INFO [StoreOpener-8b59044b04d7760c1f607e19d9c7ebef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,111 DEBUG [StoreOpener-136a229a757603f6def4b83aaff74007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf 2023-09-18 10:02:44,112 DEBUG [StoreOpener-8b59044b04d7760c1f607e19d9c7ebef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf 2023-09-18 10:02:44,112 DEBUG [StoreOpener-136a229a757603f6def4b83aaff74007-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf 2023-09-18 10:02:44,112 DEBUG [StoreOpener-8b59044b04d7760c1f607e19d9c7ebef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf 2023-09-18 10:02:44,112 INFO [StoreOpener-136a229a757603f6def4b83aaff74007-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 136a229a757603f6def4b83aaff74007 columnFamilyName cf 2023-09-18 10:02:44,112 INFO [StoreOpener-8b59044b04d7760c1f607e19d9c7ebef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b59044b04d7760c1f607e19d9c7ebef columnFamilyName cf 2023-09-18 10:02:44,113 INFO [StoreOpener-136a229a757603f6def4b83aaff74007-1] regionserver.HStore(310): Store=136a229a757603f6def4b83aaff74007/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:44,113 INFO [StoreOpener-8b59044b04d7760c1f607e19d9c7ebef-1] regionserver.HStore(310): Store=8b59044b04d7760c1f607e19d9c7ebef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:44,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:44,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:44,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:44,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 136a229a757603f6def4b83aaff74007; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73100702, jitterRate=0.08928534388542175}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:44,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 136a229a757603f6def4b83aaff74007: 2023-09-18 10:02:44,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b59044b04d7760c1f607e19d9c7ebef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61531930, jitterRate=-0.08310279250144958}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:44,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b59044b04d7760c1f607e19d9c7ebef: 2023-09-18 10:02:44,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007., pid=94, masterSystemTime=1695031364102 2023-09-18 10:02:44,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef., pid=93, masterSystemTime=1695031364102 2023-09-18 10:02:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,122 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=136a229a757603f6def4b83aaff74007, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,122 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031364122"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031364122"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031364122"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031364122"}]},"ts":"1695031364122"} 2023-09-18 10:02:44,122 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,123 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8b59044b04d7760c1f607e19d9c7ebef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,123 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031364123"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031364123"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031364123"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031364123"}]},"ts":"1695031364123"} 2023-09-18 10:02:44,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-18 10:02:44,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 136a229a757603f6def4b83aaff74007, server=jenkins-hbase4.apache.org,45923,1695031276292 in 173 msec 2023-09-18 10:02:44,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-18 10:02:44,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 8b59044b04d7760c1f607e19d9c7ebef, server=jenkins-hbase4.apache.org,34469,1695031276191 in 174 msec 2023-09-18 10:02:44,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, ASSIGN in 333 msec 2023-09-18 10:02:44,128 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-18 10:02:44,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, ASSIGN in 335 msec 2023-09-18 10:02:44,129 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:02:44,129 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031364129"}]},"ts":"1695031364129"} 2023-09-18 10:02:44,130 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-18 10:02:44,132 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:02:44,132 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-18 10:02:44,134 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-18 10:02:44,137 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:44,137 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:44,137 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:44,137 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:44,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:44,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:44,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:44,138 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:44,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 382 msec 2023-09-18 10:02:44,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-18 10:02:44,364 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-18 10:02:44,366 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:44,367 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,368 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:02:44,379 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:02:44,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031364379 (current time:1695031364379). 2023-09-18 10:02:44,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:44,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x1689deb6 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:44,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7de9d145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:44,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:44,393 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:44,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1689deb6 to 127.0.0.1:57492 2023-09-18 10:02:44,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x4a08b115 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:44,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@122cba8c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:44,403 DEBUG [hconnection-0x21fc3275-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:44,405 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:44,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:44,411 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:44,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a08b115 to 127.0.0.1:57492 2023-09-18 10:02:44,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:44,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-18 10:02:44,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:44,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:02:44,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:02:44,416 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:02:44,416 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695031964416 2023-09-18 10:02:44,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:02:44,416 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:44,417 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:44,418 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:44,418 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:02:44,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-18 10:02:44,420 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-18 10:02:44,423 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-18 10:02:44,423 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695031964423 2023-09-18 10:02:44,431 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,431 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-18 10:02:44,431 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,432 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-18 10:02:44,432 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-18 10:02:44,433 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,433 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,443 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,443 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,443 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,443 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,443 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,443 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,444 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,445 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-18 10:02:44,445 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-18 10:02:44,445 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,446 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-18 10:02:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-18 10:02:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-18 10:02:44,447 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-18 10:02:44,447 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-18 10:02:44,446 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,447 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-18 10:02:44,447 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-18 10:02:44,447 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-18 10:02:44,448 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-18 10:02:44,448 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-18 10:02:44,448 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-18 10:02:44,449 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,450 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,450 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:44,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-18 10:02:44,453 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 1] remaining members to acquire global barrier 2023-09-18 10:02:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-18 10:02:44,455 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32764b40[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:44,455 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-18 10:02:44,456 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,457 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,457 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-18 10:02:44,458 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:02:44,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:02:44,458 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,458 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:44,458 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,458 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:44,458 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. started... 2023-09-18 10:02:44,458 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,459 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. started... 2023-09-18 10:02:44,460 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 136a229a757603f6def4b83aaff74007: 2023-09-18 10:02:44,460 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8b59044b04d7760c1f607e19d9c7ebef: 2023-09-18 10:02:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-18 10:02:44,460 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,460 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,460 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:44,460 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-18 10:02:44,460 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:44,461 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:02:44,461 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:02:44,469 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. completed. 2023-09-18 10:02:44,469 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-18 10:02:44,469 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. completed. 2023-09-18 10:02:44,469 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-18 10:02:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-18 10:02:44,471 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-18 10:02:44,472 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-18 10:02:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-18 10:02:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34469,1695031276191': 2023-09-18 10:02:44,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-18 10:02:44,479 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-18 10:02:44,479 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:44,479 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:44,479 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,479 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,482 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,483 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,484 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,485 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,486 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,486 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,489 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,489 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,488 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,489 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,489 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,489 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:44,490 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,490 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,489 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,490 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:02:44,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,490 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,491 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,491 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-18 10:02:44,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,518 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:44,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,518 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-18 10:02:44,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:02:44,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:44,519 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695031364416Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695031364499 (+83 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695031364499Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695031364499Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695031364502 (+3 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695031364512 (+10 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695031364518 (+6 ms) 2023-09-18 10:02:44,522 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-18 10:02:44,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 105 msec 2023-09-18 10:02:44,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34469] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:02:44,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:02:44,528 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:44,528 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,528 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:02:44,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:02:44,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031364539 (current time:1695031364539). 2023-09-18 10:02:44,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:44,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x59b83a12 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:44,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1917d4ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:44,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:44,550 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:44,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59b83a12 to 127.0.0.1:57492 2023-09-18 10:02:44,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:44,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x6a82eb0f to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:44,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72f234e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:44,559 DEBUG [hconnection-0x55e41ff7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:44,560 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:44,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:44,565 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:44,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a82eb0f to 127.0.0.1:57492 2023-09-18 10:02:44,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:44,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-18 10:02:44,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:44,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:02:44,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:02:44,570 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:02:44,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-18 10:02:44,571 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695031964571 2023-09-18 10:02:44,571 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:44,572 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:44,572 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:44,573 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-18 10:02:44,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-18 10:02:44,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-18 10:02:44,575 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-18 10:02:44,575 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695031964575 2023-09-18 10:02:44,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,583 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-18 10:02:44,584 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,584 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-18 10:02:44,585 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-18 10:02:44,585 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,585 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,586 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,586 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,586 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,586 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,587 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,587 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,587 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,587 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:44,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-18 10:02:44,588 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-18 10:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-18 10:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-18 10:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-18 10:02:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-18 10:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-18 10:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-18 10:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:44,590 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-18 10:02:44,593 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-18 10:02:44,593 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-18 10:02:44,593 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-18 10:02:44,595 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,595 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,595 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,597 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,597 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 1] remaining members to acquire global barrier 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-18 10:02:44,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@663aa3cf[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:44,601 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-18 10:02:44,601 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:02:44,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-18 10:02:44,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:02:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-18 10:02:44,605 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,606 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:44,606 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:44,606 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:44,606 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:44,606 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,606 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,606 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:44,606 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,606 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. started... 2023-09-18 10:02:44,606 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. started... 2023-09-18 10:02:44,606 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8b59044b04d7760c1f607e19d9c7ebef 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-18 10:02:44,606 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 136a229a757603f6def4b83aaff74007 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-18 10:02:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-18 10:02:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,607 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-18 10:02:44,624 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230918b40175936dda463e8201e2df2899a13b to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230918b40175936dda463e8201e2df2899a13b 2023-09-18 10:02:44,625 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091834b710027ca141969cab007c159eaaa5 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091834b710027ca141969cab007c159eaaa5 2023-09-18 10:02:44,632 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/.tmp/cf/04107efd0ccf42c686ca23c206b6657e 2023-09-18 10:02:44,634 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/.tmp/cf/cac75086bc534800a5761215ba516a3e 2023-09-18 10:02:44,637 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/.tmp/cf/04107efd0ccf42c686ca23c206b6657e as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf/04107efd0ccf42c686ca23c206b6657e 2023-09-18 10:02:44,640 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/.tmp/cf/cac75086bc534800a5761215ba516a3e as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf/cac75086bc534800a5761215ba516a3e 2023-09-18 10:02:44,643 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf/04107efd0ccf42c686ca23c206b6657e, entries=5, sequenceid=6, filesize=5.8 K 2023-09-18 10:02:44,643 INFO [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 8b59044b04d7760c1f607e19d9c7ebef in 37ms, sequenceid=6, compaction requested=false 2023-09-18 10:02:44,643 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-18 10:02:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8b59044b04d7760c1f607e19d9c7ebef: 2023-09-18 10:02:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf/04107efd0ccf42c686ca23c206b6657e] hfiles 2023-09-18 10:02:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf/04107efd0ccf42c686ca23c206b6657e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,645 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf/cac75086bc534800a5761215ba516a3e, entries=45, sequenceid=6, filesize=12.7 K 2023-09-18 10:02:44,646 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 136a229a757603f6def4b83aaff74007 in 40ms, sequenceid=6, compaction requested=false 2023-09-18 10:02:44,650 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 136a229a757603f6def4b83aaff74007: 2023-09-18 10:02:44,650 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,652 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:44,652 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf/cac75086bc534800a5761215ba516a3e] hfiles 2023-09-18 10:02:44,652 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf/cac75086bc534800a5761215ba516a3e for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,661 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. completed. 2023-09-18 10:02:44,661 DEBUG [rs(jenkins-hbase4.apache.org,34469,1695031276191)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:44,661 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:44,661 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:44,661 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,661 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-18 10:02:44,661 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:44,663 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-18 10:02:44,663 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,663 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,663 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-18 10:02:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,665 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. completed. 2023-09-18 10:02:44,665 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:44,665 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:44,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,665 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:44,665 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,665 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-18 10:02:44,665 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,667 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,667 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-18 10:02:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,667 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,667 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-18 10:02:44,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34469,1695031276191': 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,672 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:44,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:44,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-18 10:02:44,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:02:44,673 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-18 10:02:44,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:02:44,673 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:44,673 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:44,673 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,673 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:44,673 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,676 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,676 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:44,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,677 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:44,678 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:44,679 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,679 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,680 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:44,682 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,683 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:44,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,682 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:44,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,683 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:02:44,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:44,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:44,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,685 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091834b710027ca141969cab007c159eaaa5, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230918b40175936dda463e8201e2df2899a13b] mob files 2023-09-18 10:02:44,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091834b710027ca141969cab007c159eaaa5 2023-09-18 10:02:44,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230918b40175936dda463e8201e2df2899a13b 2023-09-18 10:02:44,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,722 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-18 10:02:44,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,722 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695031364571Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695031364696 (+125 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695031364696Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695031364696Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695031364702 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695031364712 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695031364722 (+10 ms) 2023-09-18 10:02:44,725 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-18 10:02:44,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 153 msec 2023-09-18 10:02:44,874 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:44,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-18 10:02:44,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:44,875 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875 2023-09-18 10:02:44,875 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44901, tgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875, rawTgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:44,898 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:44,898 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1119994131_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,898 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-18 10:02:44,904 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:44,920 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:44,920 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:44,921 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:44,921 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,791 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-35766799389789837.jar 2023-09-18 10:02:45,791 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,792 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,858 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-2750295745098802014.jar 2023-09-18 10:02:45,858 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,859 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,859 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,859 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,860 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,860 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:45,860 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:02:45,861 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:02:45,861 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:02:45,861 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:02:45,862 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:02:45,862 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:02:45,863 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:02:45,863 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:02:45,863 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:02:45,864 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:02:45,864 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:45,865 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:45,865 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:45,865 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:45,866 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:45,866 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:45,867 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:46,208 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:02:46,210 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-18 10:02:47,943 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:47,943 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:47,946 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0005_000001 (auth:SIMPLE) 2023-09-18 10:02:48,395 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0006_000001 (auth:SIMPLE) 2023-09-18 10:02:48,618 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:02:52,119 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0006_000001 (auth:SIMPLE) 2023-09-18 10:02:54,546 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:02:54,546 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:02:54,553 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:54,553 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:02:54,554 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:02:54,554 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:54,554 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-18 10:02:54,554 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-18 10:02:54,554 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:54,555 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-18 10:02:54,555 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031364875/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-18 10:02:54,561 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-18 10:02:54,566 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031374566"}]},"ts":"1695031374566"} 2023-09-18 10:02:54,567 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-18 10:02:54,569 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-18 10:02:54,570 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, UNASSIGN}] 2023-09-18 10:02:54,574 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, UNASSIGN 2023-09-18 10:02:54,574 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, UNASSIGN 2023-09-18 10:02:54,575 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=136a229a757603f6def4b83aaff74007, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:54,575 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8b59044b04d7760c1f607e19d9c7ebef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:54,575 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031374575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031374575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031374575"}]},"ts":"1695031374575"} 2023-09-18 10:02:54,575 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031374575"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031374575"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031374575"}]},"ts":"1695031374575"} 2023-09-18 10:02:54,577 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 136a229a757603f6def4b83aaff74007, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:54,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 8b59044b04d7760c1f607e19d9c7ebef, server=jenkins-hbase4.apache.org,34469,1695031276191}] 2023-09-18 10:02:54,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-18 10:02:54,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:54,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 136a229a757603f6def4b83aaff74007, disabling compactions & flushes 2023-09-18 10:02:54,730 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:54,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:54,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. after waiting 0 ms 2023-09-18 10:02:54,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:54,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:54,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b59044b04d7760c1f607e19d9c7ebef, disabling compactions & flushes 2023-09-18 10:02:54,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:54,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:54,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. after waiting 0 ms 2023-09-18 10:02:54,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:54,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:02:54,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:02:54,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:54,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007. 2023-09-18 10:02:54,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 136a229a757603f6def4b83aaff74007: 2023-09-18 10:02:54,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:02:54,742 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef. 2023-09-18 10:02:54,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b59044b04d7760c1f607e19d9c7ebef: 2023-09-18 10:02:54,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 136a229a757603f6def4b83aaff74007 2023-09-18 10:02:54,744 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=136a229a757603f6def4b83aaff74007, regionState=CLOSED 2023-09-18 10:02:54,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:54,744 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031374743"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031374743"}]},"ts":"1695031374743"} 2023-09-18 10:02:54,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8b59044b04d7760c1f607e19d9c7ebef, regionState=CLOSED 2023-09-18 10:02:54,744 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695031374744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031374744"}]},"ts":"1695031374744"} 2023-09-18 10:02:54,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-18 10:02:54,746 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 136a229a757603f6def4b83aaff74007, server=jenkins-hbase4.apache.org,45923,1695031276292 in 169 msec 2023-09-18 10:02:54,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-18 10:02:54,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 8b59044b04d7760c1f607e19d9c7ebef, server=jenkins-hbase4.apache.org,34469,1695031276191 in 169 msec 2023-09-18 10:02:54,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=136a229a757603f6def4b83aaff74007, UNASSIGN in 176 msec 2023-09-18 10:02:54,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=99 2023-09-18 10:02:54,749 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8b59044b04d7760c1f607e19d9c7ebef, UNASSIGN in 177 msec 2023-09-18 10:02:54,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031374749"}]},"ts":"1695031374749"} 2023-09-18 10:02:54,750 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-18 10:02:54,751 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-18 10:02:54,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 191 msec 2023-09-18 10:02:54,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-18 10:02:54,868 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-18 10:02:54,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,872 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,872 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,874 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,877 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:54,877 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 2023-09-18 10:02:54,877 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,877 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,877 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,877 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-18 10:02:54,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-18 10:02:54,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-18 10:02:54,877 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:54,878 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:54,879 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/recovered.edits] 2023-09-18 10:02:54,879 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/recovered.edits] 2023-09-18 10:02:54,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-18 10:02:54,883 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf/cac75086bc534800a5761215ba516a3e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/cf/cac75086bc534800a5761215ba516a3e 2023-09-18 10:02:54,884 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf/04107efd0ccf42c686ca23c206b6657e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/cf/04107efd0ccf42c686ca23c206b6657e 2023-09-18 10:02:54,887 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007/recovered.edits/9.seqid 2023-09-18 10:02:54,887 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef/recovered.edits/9.seqid 2023-09-18 10:02:54,887 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/136a229a757603f6def4b83aaff74007 2023-09-18 10:02:54,887 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testEmptyExportFileSystemState/8b59044b04d7760c1f607e19d9c7ebef 2023-09-18 10:02:54,887 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-18 10:02:54,888 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-18 10:02:54,889 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-18 10:02:54,892 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091834b710027ca141969cab007c159eaaa5 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023091834b710027ca141969cab007c159eaaa5 2023-09-18 10:02:54,893 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230918b40175936dda463e8201e2df2899a13b to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230918b40175936dda463e8201e2df2899a13b 2023-09-18 10:02:54,893 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-18 10:02:54,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,898 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-18 10:02:54,900 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-18 10:02:54,901 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,901 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-18 10:02:54,901 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031374901"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:54,901 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031374901"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:54,903 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-18 10:02:54,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8b59044b04d7760c1f607e19d9c7ebef, NAME => 'testtb-testEmptyExportFileSystemState,,1695031363756.8b59044b04d7760c1f607e19d9c7ebef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 136a229a757603f6def4b83aaff74007, NAME => 'testtb-testEmptyExportFileSystemState,1,1695031363756.136a229a757603f6def4b83aaff74007.', STARTKEY => '1', ENDKEY => ''}] 2023-09-18 10:02:54,903 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-18 10:02:54,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031374903"}]},"ts":"9223372036854775807"} 2023-09-18 10:02:54,906 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-18 10:02:54,908 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-18 10:02:54,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-18 10:02:54,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-18 10:02:54,981 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-18 10:02:54,988 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-18 10:02:54,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:54,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-18 10:02:54,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-18 10:02:55,018 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 759) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:40641 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4613 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x614d5738-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:37962 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1944564298_1 at /127.0.0.1:37934 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x614d5738-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:33441 from appattempt_1695031282809_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2117803992_17 at /127.0.0.1:41964 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (2013113489) connection to jenkins-hbase4.apache.org/172.31.14.131:42219 from appattempt_1695031282809_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1944564298_1 at /127.0.0.1:39698 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 213), ProcessCount=167 (was 167), AvailableMemoryMB=7930 (was 7968) 2023-09-18 10:02:55,018 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-18 10:02:55,037 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=167, AvailableMemoryMB=7930 2023-09-18 10:02:55,038 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-18 10:02:55,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-18 10:02:55,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,042 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-18 10:02:55,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-18 10:02:55,042 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-18 10:02:55,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-18 10:02:55,044 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,044 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,045 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 empty. 2023-09-18 10:02:55,045 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 empty. 2023-09-18 10:02:55,045 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,045 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,045 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-18 10:02:55,055 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-18 10:02:55,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e98539fae6e48ccd1b87905377f17712, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:55,056 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6601bcc52f0dff4b4d8d1b37c6ac6590, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp 2023-09-18 10:02:55,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:55,079 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e98539fae6e48ccd1b87905377f17712, disabling compactions & flushes 2023-09-18 10:02:55,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. after waiting 0 ms 2023-09-18 10:02:55,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,080 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,080 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e98539fae6e48ccd1b87905377f17712: 2023-09-18 10:02:55,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:55,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 6601bcc52f0dff4b4d8d1b37c6ac6590, disabling compactions & flushes 2023-09-18 10:02:55,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. after waiting 0 ms 2023-09-18 10:02:55,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,081 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,081 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 6601bcc52f0dff4b4d8d1b37c6ac6590: 2023-09-18 10:02:55,083 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-18 10:02:55,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031375084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031375084"}]},"ts":"1695031375084"} 2023-09-18 10:02:55,084 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031375084"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031375084"}]},"ts":"1695031375084"} 2023-09-18 10:02:55,086 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-18 10:02:55,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-18 10:02:55,087 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031375087"}]},"ts":"1695031375087"} 2023-09-18 10:02:55,088 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-18 10:02:55,093 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-18 10:02:55,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-18 10:02:55,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-18 10:02:55,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-18 10:02:55,094 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-18 10:02:55,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, ASSIGN}] 2023-09-18 10:02:55,097 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, ASSIGN 2023-09-18 10:02:55,097 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, ASSIGN 2023-09-18 10:02:55,098 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45923,1695031276292; forceNewPlan=false, retain=false 2023-09-18 10:02:55,098 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33575,1695031276250; forceNewPlan=false, retain=false 2023-09-18 10:02:55,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-18 10:02:55,248 INFO [jenkins-hbase4:34087] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-18 10:02:55,251 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6601bcc52f0dff4b4d8d1b37c6ac6590, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,251 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e98539fae6e48ccd1b87905377f17712, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,251 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031375251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031375251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031375251"}]},"ts":"1695031375251"} 2023-09-18 10:02:55,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031375251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031375251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031375251"}]},"ts":"1695031375251"} 2023-09-18 10:02:55,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 6601bcc52f0dff4b4d8d1b37c6ac6590, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:02:55,253 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure e98539fae6e48ccd1b87905377f17712, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:02:55,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-18 10:02:55,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6601bcc52f0dff4b4d8d1b37c6ac6590, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.', STARTKEY => '1', ENDKEY => ''} 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. service=AccessControlService 2023-09-18 10:02:55,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:55,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e98539fae6e48ccd1b87905377f17712, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.', STARTKEY => '', ENDKEY => '1'} 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. service=AccessControlService 2023-09-18 10:02:55,409 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-18 10:02:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-18 10:02:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,410 INFO [StoreOpener-6601bcc52f0dff4b4d8d1b37c6ac6590-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,410 INFO [StoreOpener-e98539fae6e48ccd1b87905377f17712-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,411 DEBUG [StoreOpener-6601bcc52f0dff4b4d8d1b37c6ac6590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf 2023-09-18 10:02:55,411 DEBUG [StoreOpener-6601bcc52f0dff4b4d8d1b37c6ac6590-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf 2023-09-18 10:02:55,411 DEBUG [StoreOpener-e98539fae6e48ccd1b87905377f17712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf 2023-09-18 10:02:55,411 DEBUG [StoreOpener-e98539fae6e48ccd1b87905377f17712-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf 2023-09-18 10:02:55,411 INFO [StoreOpener-6601bcc52f0dff4b4d8d1b37c6ac6590-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6601bcc52f0dff4b4d8d1b37c6ac6590 columnFamilyName cf 2023-09-18 10:02:55,411 INFO [StoreOpener-e98539fae6e48ccd1b87905377f17712-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e98539fae6e48ccd1b87905377f17712 columnFamilyName cf 2023-09-18 10:02:55,413 INFO [StoreOpener-6601bcc52f0dff4b4d8d1b37c6ac6590-1] regionserver.HStore(310): Store=6601bcc52f0dff4b4d8d1b37c6ac6590/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:55,413 INFO [StoreOpener-e98539fae6e48ccd1b87905377f17712-1] regionserver.HStore(310): Store=e98539fae6e48ccd1b87905377f17712/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-18 10:02:55,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:02:55,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e98539fae6e48ccd1b87905377f17712 2023-09-18 10:02:55,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:55,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-18 10:02:55,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6601bcc52f0dff4b4d8d1b37c6ac6590; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69479333, jitterRate=0.03532274067401886}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:55,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6601bcc52f0dff4b4d8d1b37c6ac6590: 2023-09-18 10:02:55,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e98539fae6e48ccd1b87905377f17712; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59598207, jitterRate=-0.11191751062870026}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-18 10:02:55,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e98539fae6e48ccd1b87905377f17712: 2023-09-18 10:02:55,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590., pid=108, masterSystemTime=1695031375404 2023-09-18 10:02:55,421 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712., pid=109, masterSystemTime=1695031375406 2023-09-18 10:02:55,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,422 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=6601bcc52f0dff4b4d8d1b37c6ac6590, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,423 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031375422"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031375422"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031375422"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031375422"}]},"ts":"1695031375422"} 2023-09-18 10:02:55,423 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e98539fae6e48ccd1b87905377f17712, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,423 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031375423"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695031375423"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695031375423"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695031375423"}]},"ts":"1695031375423"} 2023-09-18 10:02:55,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=107 2023-09-18 10:02:55,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 6601bcc52f0dff4b4d8d1b37c6ac6590, server=jenkins-hbase4.apache.org,33575,1695031276250 in 171 msec 2023-09-18 10:02:55,426 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-09-18 10:02:55,427 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure e98539fae6e48ccd1b87905377f17712, server=jenkins-hbase4.apache.org,45923,1695031276292 in 172 msec 2023-09-18 10:02:55,427 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, ASSIGN in 332 msec 2023-09-18 10:02:55,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=106, resume processing ppid=105 2023-09-18 10:02:55,428 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, ASSIGN in 332 msec 2023-09-18 10:02:55,428 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-18 10:02:55,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031375429"}]},"ts":"1695031375429"} 2023-09-18 10:02:55,430 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-18 10:02:55,431 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-18 10:02:55,432 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-18 10:02:55,433 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-18 10:02:55,434 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:55,434 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:55,434 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:55,434 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:02:55,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:55,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:55,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:55,436 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-18 10:02:55,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 396 msec 2023-09-18 10:02:55,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-18 10:02:55,646 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-18 10:02:55,649 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,649 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,650 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:02:55,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-18 10:02:55,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031375662 (current time:1695031375662). 2023-09-18 10:02:55,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:55,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x5de205a3 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:55,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71179e9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:55,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:55,673 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:55,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5de205a3 to 127.0.0.1:57492 2023-09-18 10:02:55,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:55,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x0f72ccee to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:55,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42f00fbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:55,681 DEBUG [hconnection-0xfdeb23d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:55,683 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:55,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:55,688 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:55,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0f72ccee to 127.0.0.1:57492 2023-09-18 10:02:55,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:55,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-18 10:02:55,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:55,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-18 10:02:55,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-18 10:02:55,693 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-18 10:02:55,694 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695031975694 2023-09-18 10:02:55,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-18 10:02:55,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,695 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:55,695 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:55,696 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-18 10:02:55,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-18 10:02:55,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-18 10:02:55,697 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-18 10:02:55,698 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695031975698 2023-09-18 10:02:55,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,715 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-18 10:02:55,715 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:55,716 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-18 10:02:55,716 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-18 10:02:55,717 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,717 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,719 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:55,719 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:55,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:55,719 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:55,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:55,719 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:55,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,719 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,719 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,720 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-18 10:02:55,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-18 10:02:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:55,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-18 10:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-18 10:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:55,722 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-18 10:02:55,723 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-18 10:02:55,724 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-18 10:02:55,731 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,731 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:55,732 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,732 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 1] remaining members to acquire global barrier 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:55,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-18 10:02:55,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787928c6[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:55,735 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-18 10:02:55,736 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,737 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,737 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,737 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-18 10:02:55,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,738 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,738 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-18 10:02:55,738 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. started... 2023-09-18 10:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:55,739 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:55,739 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6601bcc52f0dff4b4d8d1b37c6ac6590: 2023-09-18 10:02:55,739 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,738 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-18 10:02:55,738 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,739 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,739 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:55,739 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:55,739 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-18 10:02:55,739 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. started... 2023-09-18 10:02:55,739 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:55,739 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:02:55,740 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e98539fae6e48ccd1b87905377f17712: 2023-09-18 10:02:55,740 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,740 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:55,740 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-18 10:02:55,741 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-18 10:02:55,741 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:55,741 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-18 10:02:55,748 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. completed. 2023-09-18 10:02:55,748 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-18 10:02:55,748 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:55,749 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-18 10:02:55,749 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,749 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:55,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:55,750 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-18 10:02:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,753 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. completed. 2023-09-18 10:02:55,754 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-18 10:02:55,754 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,755 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-18 10:02:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:55,755 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:55,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33575,1695031276250': 2023-09-18 10:02:55,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-18 10:02:55,760 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-18 10:02:55,760 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:55,760 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:55,760 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,760 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:55,762 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:55,763 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:55,762 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:55,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:55,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,763 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:55,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,764 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:55,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:55,764 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:55,766 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,766 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,766 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,769 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:55,769 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:55,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:55,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:55,769 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:55,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,769 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:55,769 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,769 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:55,769 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:55,769 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:55,771 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:55,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:55,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:55,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:55,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:55,771 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:55,771 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,771 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:55,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,772 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-18 10:02:55,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,795 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-18 10:02:55,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:02:55,796 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:02:55,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,801 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-18 10:02:55,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,802 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:55,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695031375694Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695031375781 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695031375781Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695031375782 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695031375784 (+2 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695031375792 (+8 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695031375801 (+9 ms) 2023-09-18 10:02:55,805 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-18 10:02:55,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 110 msec 2023-09-18 10:02:55,996 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-18 10:02:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:56,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45923] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:02:56,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33575] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. with WAL disabled. Data may be lost in the event of a crash. 2023-09-18 10:02:56,004 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,004 DEBUG [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:56,004 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-18 10:02:56,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-18 10:02:56,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695031376013 (current time:1695031376013). 2023-09-18 10:02:56,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-18 10:02:56,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x75d4dc33 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:56,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f61d7ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:56,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:56,022 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:56,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75d4dc33 to 127.0.0.1:57492 2023-09-18 10:02:56,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:56,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(139): Connect 0x73f50186 to 127.0.0.1:57492 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-18 10:02:56,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20937e8f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-18 10:02:56,031 DEBUG [hconnection-0x214c03d4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:56,034 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60334, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:56,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-18 10:02:56,044 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-18 10:02:56,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73f50186 to 127.0.0.1:57492 2023-09-18 10:02:56,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:02:56,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-18 10:02:56,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-18 10:02:56,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-18 10:02:56,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-18 10:02:56,049 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-18 10:02:56,050 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695031976049 2023-09-18 10:02:56,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-18 10:02:56,050 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,051 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-18 10:02:56,051 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-18 10:02:56,052 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-18 10:02:56,052 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-18 10:02:56,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-18 10:02:56,053 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-18 10:02:56,054 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695031976054 2023-09-18 10:02:56,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,067 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-18 10:02:56,067 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:56,068 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-18 10:02:56,068 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-18 10:02:56,069 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,069 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,070 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:56,070 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:56,070 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:56,070 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:56,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:56,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:56,071 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,071 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,071 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,071 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-18 10:02:56,072 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-18 10:02:56,072 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:56,077 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34469,1695031276191' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-18 10:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-18 10:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-18 10:02:56,078 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-18 10:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-18 10:02:56,079 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-18 10:02:56,081 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,082 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,082 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:56,082 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,082 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:56,082 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,082 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:56,083 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,083 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:56,083 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,083 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-18 10:02:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:56,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45923,1695031276292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2176756e[Count = 1] remaining members to acquire global barrier 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:56,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:56,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33575,1695031276250' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-18 10:02:56,087 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2176756e[Count = 0] remaining members to acquire global barrier 2023-09-18 10:02:56,087 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-18 10:02:56,087 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-18 10:02:56,091 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:56,092 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-18 10:02:56,092 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:56,092 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. started... 2023-09-18 10:02:56,092 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. started... 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-18 10:02:56,092 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,092 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6601bcc52f0dff4b4d8d1b37c6ac6590 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-18 10:02:56,092 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34469,1695031276191' in zk 2023-09-18 10:02:56,092 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-18 10:02:56,092 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e98539fae6e48ccd1b87905377f17712 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-18 10:02:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-18 10:02:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:56,094 DEBUG [member: 'jenkins-hbase4.apache.org,34469,1695031276191' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-18 10:02:56,119 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230918c41b9ea63fc84711a302be0d1d9e009e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230918c41b9ea63fc84711a302be0d1d9e009e 2023-09-18 10:02:56,119 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230918f967d6c0f7324fc7aa3b7b5dfc3b0cbc to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230918f967d6c0f7324fc7aa3b7b5dfc3b0cbc 2023-09-18 10:02:56,135 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/.tmp/cf/3865b220e1874cce81f32a690656176a 2023-09-18 10:02:56,135 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/.tmp/cf/2f4934a617cf448face283fdae4bb117 2023-09-18 10:02:56,140 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/.tmp/cf/3865b220e1874cce81f32a690656176a as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf/3865b220e1874cce81f32a690656176a 2023-09-18 10:02:56,141 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/.tmp/cf/2f4934a617cf448face283fdae4bb117 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf/2f4934a617cf448face283fdae4bb117 2023-09-18 10:02:56,145 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf/3865b220e1874cce81f32a690656176a, entries=3, sequenceid=6, filesize=5.4 K 2023-09-18 10:02:56,145 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf/2f4934a617cf448face283fdae4bb117, entries=47, sequenceid=6, filesize=13.4 K 2023-09-18 10:02:56,145 INFO [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for e98539fae6e48ccd1b87905377f17712 in 53ms, sequenceid=6, compaction requested=false 2023-09-18 10:02:56,146 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-18 10:02:56,146 INFO [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 6601bcc52f0dff4b4d8d1b37c6ac6590 in 54ms, sequenceid=6, compaction requested=false 2023-09-18 10:02:56,146 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e98539fae6e48ccd1b87905377f17712: 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6601bcc52f0dff4b4d8d1b37c6ac6590: 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf/3865b220e1874cce81f32a690656176a] hfiles 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf/2f4934a617cf448face283fdae4bb117] hfiles 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf/3865b220e1874cce81f32a690656176a for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,148 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf/2f4934a617cf448face283fdae4bb117 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,151 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:56,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-18 10:02:56,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-18 10:02:56,152 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-18 10:02:56,159 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. completed. 2023-09-18 10:02:56,159 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. completed. 2023-09-18 10:02:56,159 DEBUG [rs(jenkins-hbase4.apache.org,45923,1695031276292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:02:56,159 DEBUG [rs(jenkins-hbase4.apache.org,33575,1695031276250)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-18 10:02:56,159 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,160 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33575,1695031276250' in zk 2023-09-18 10:02:56,160 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-18 10:02:56,160 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45923,1695031276292' in zk 2023-09-18 10:02:56,161 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-18 10:02:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:56,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-18 10:02:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:56,161 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,45923,1695031276292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-18 10:02:56,161 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:56,163 DEBUG [member: 'jenkins-hbase4.apache.org,33575,1695031276250' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-18 10:02:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33575,1695031276250': 2023-09-18 10:02:56,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33575,1695031276250' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-18 10:02:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:56,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45923,1695031276292': 2023-09-18 10:02:56,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45923,1695031276292' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-18 10:02:56,173 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-18 10:02:56,173 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-18 10:02:56,173 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-18 10:02:56,173 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,173 INFO [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-18 10:02:56,175 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:56,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-18 10:02:56,175 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,175 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:56,176 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-18 10:02:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:56,176 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,177 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-18 10:02:56,177 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-18 10:02:56,179 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,179 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,179 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:56,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:56,182 DEBUG [(jenkins-hbase4.apache.org,34087,1695031274865)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-18 10:02:56,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:56,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:56,184 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:56,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,182 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:56,213 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-18 10:02:56,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:56,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-18 10:02:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-18 10:02:56,184 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-18 10:02:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:56,213 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,213 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,213 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:02:56,213 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,214 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:02:56,214 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:02:56,214 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,214 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-18 10:02:56,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-18 10:02:56,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230918c41b9ea63fc84711a302be0d1d9e009e, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230918f967d6c0f7324fc7aa3b7b5dfc3b0cbc] mob files 2023-09-18 10:02:56,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230918c41b9ea63fc84711a302be0d1d9e009e 2023-09-18 10:02:56,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230918f967d6c0f7324fc7aa3b7b5dfc3b0cbc 2023-09-18 10:02:56,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,221 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-18 10:02:56,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,240 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695031376050Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695031376221 (+171 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695031376221Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695031376221Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695031376224 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695031376232 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695031376239 (+7 ms) 2023-09-18 10:02:56,242 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-18 10:02:56,244 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 191 msec 2023-09-18 10:02:56,352 DEBUG [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-18 10:02:56,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-18 10:02:56,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-18 10:02:56,354 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354 2023-09-18 10:02:56,354 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44901, tgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354, rawTgtDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354, srcFsUri=hdfs://localhost:44901, srcDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:56,382 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268 2023-09-18 10:02:56,382 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1093716863_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,382 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44901, inputRoot=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268, snapshotDir=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-18 10:02:56,391 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:02:56,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:56,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:56,408 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:56,409 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,280 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-557044385612677122.jar 2023-09-18 10:02:57,280 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,280 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,347 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/hadoop-1855315426834851898.jar 2023-09-18 10:02:57,347 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,348 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,348 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,348 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,349 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,349 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-18 10:02:57,350 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-18 10:02:57,350 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-18 10:02:57,350 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-18 10:02:57,351 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-18 10:02:57,351 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-18 10:02:57,351 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-18 10:02:57,352 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-18 10:02:57,352 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-18 10:02:57,352 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-18 10:02:57,353 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-18 10:02:57,353 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:57,354 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:57,354 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:57,354 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:57,355 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-18 10:02:57,355 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:57,356 DEBUG [Listener at jenkins-hbase4.apache.org/40259] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-18 10:02:57,676 WARN [Listener at jenkins-hbase4.apache.org/40259] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-18 10:02:57,678 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-18 10:02:57,680 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-18 10:02:59,441 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:59,441 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-18 10:02:59,443 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0006_000001 (auth:SIMPLE) 2023-09-18 10:02:59,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0007_000001 (auth:SIMPLE) 2023-09-18 10:03:00,318 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:03:03,744 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0007_000001 (auth:SIMPLE) 2023-09-18 10:03:05,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0007_000001 (auth:SIMPLE) 2023-09-18 10:03:08,497 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0007_000001 (auth:SIMPLE) 2023-09-18 10:03:09,950 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-18 10:03:09,950 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-18 10:03:09,961 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:09,961 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-18 10:03:09,962 INFO [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-18 10:03:09,962 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:09,962 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-18 10:03:09,962 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-18 10:03:09,963 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2117803992_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:09,963 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-18 10:03:09,963 DEBUG [Listener at jenkins-hbase4.apache.org/40259] snapshot.TestExportSnapshot(367): hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/export-test/export-1695031376354/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-18 10:03:09,968 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:09,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:09,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:09,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-18 10:03:09,972 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031389972"}]},"ts":"1695031389972"} 2023-09-18 10:03:09,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-18 10:03:09,975 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-18 10:03:09,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, UNASSIGN}] 2023-09-18 10:03:09,977 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, UNASSIGN 2023-09-18 10:03:09,977 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, UNASSIGN 2023-09-18 10:03:09,978 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e98539fae6e48ccd1b87905377f17712, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:03:09,978 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6601bcc52f0dff4b4d8d1b37c6ac6590, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:03:09,978 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031389978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031389978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031389978"}]},"ts":"1695031389978"} 2023-09-18 10:03:09,978 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031389978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695031389978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695031389978"}]},"ts":"1695031389978"} 2023-09-18 10:03:09,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 6601bcc52f0dff4b4d8d1b37c6ac6590, server=jenkins-hbase4.apache.org,33575,1695031276250}] 2023-09-18 10:03:09,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure e98539fae6e48ccd1b87905377f17712, server=jenkins-hbase4.apache.org,45923,1695031276292}] 2023-09-18 10:03:10,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-18 10:03:10,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:03:10,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6601bcc52f0dff4b4d8d1b37c6ac6590, disabling compactions & flushes 2023-09-18 10:03:10,131 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:03:10,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:03:10,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. after waiting 0 ms 2023-09-18 10:03:10,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:03:10,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e98539fae6e48ccd1b87905377f17712 2023-09-18 10:03:10,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e98539fae6e48ccd1b87905377f17712, disabling compactions & flushes 2023-09-18 10:03:10,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:03:10,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:03:10,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. after waiting 0 ms 2023-09-18 10:03:10,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:03:10,144 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:03:10,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:03:10,145 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:10,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590. 2023-09-18 10:03:10,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6601bcc52f0dff4b4d8d1b37c6ac6590: 2023-09-18 10:03:10,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:10,146 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712. 2023-09-18 10:03:10,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e98539fae6e48ccd1b87905377f17712: 2023-09-18 10:03:10,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:03:10,148 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=6601bcc52f0dff4b4d8d1b37c6ac6590, regionState=CLOSED 2023-09-18 10:03:10,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e98539fae6e48ccd1b87905377f17712 2023-09-18 10:03:10,148 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031390148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031390148"}]},"ts":"1695031390148"} 2023-09-18 10:03:10,148 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e98539fae6e48ccd1b87905377f17712, regionState=CLOSED 2023-09-18 10:03:10,149 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695031390148"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695031390148"}]},"ts":"1695031390148"} 2023-09-18 10:03:10,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-18 10:03:10,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 6601bcc52f0dff4b4d8d1b37c6ac6590, server=jenkins-hbase4.apache.org,33575,1695031276250 in 170 msec 2023-09-18 10:03:10,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-18 10:03:10,154 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure e98539fae6e48ccd1b87905377f17712, server=jenkins-hbase4.apache.org,45923,1695031276292 in 170 msec 2023-09-18 10:03:10,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6601bcc52f0dff4b4d8d1b37c6ac6590, UNASSIGN in 179 msec 2023-09-18 10:03:10,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-18 10:03:10,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e98539fae6e48ccd1b87905377f17712, UNASSIGN in 179 msec 2023-09-18 10:03:10,156 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695031390156"}]},"ts":"1695031390156"} 2023-09-18 10:03:10,157 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-18 10:03:10,159 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-18 10:03:10,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 191 msec 2023-09-18 10:03:10,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-18 10:03:10,274 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-18 10:03:10,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,278 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,279 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,280 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34469] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,283 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 2023-09-18 10:03:10,283 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:03:10,284 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,284 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,284 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,284 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,284 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-18 10:03:10,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-18 10:03:10,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-18 10:03:10,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-18 10:03:10,285 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/recovered.edits] 2023-09-18 10:03:10,285 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf, FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/recovered.edits] 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,286 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-18 10:03:10,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-18 10:03:10,289 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf/2f4934a617cf448face283fdae4bb117 to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/cf/2f4934a617cf448face283fdae4bb117 2023-09-18 10:03:10,289 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf/3865b220e1874cce81f32a690656176a to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/cf/3865b220e1874cce81f32a690656176a 2023-09-18 10:03:10,292 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590/recovered.edits/9.seqid 2023-09-18 10:03:10,292 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/recovered.edits/9.seqid to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712/recovered.edits/9.seqid 2023-09-18 10:03:10,293 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6601bcc52f0dff4b4d8d1b37c6ac6590 2023-09-18 10:03:10,293 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e98539fae6e48ccd1b87905377f17712 2023-09-18 10:03:10,293 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-18 10:03:10,293 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-18 10:03:10,294 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-18 10:03:10,296 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230918c41b9ea63fc84711a302be0d1d9e009e to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230918c41b9ea63fc84711a302be0d1d9e009e 2023-09-18 10:03:10,297 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230918f967d6c0f7324fc7aa3b7b5dfc3b0cbc to hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230918f967d6c0f7324fc7aa3b7b5dfc3b0cbc 2023-09-18 10:03:10,298 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-18 10:03:10,299 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,301 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-18 10:03:10,303 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-18 10:03:10,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-18 10:03:10,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031390304"}]},"ts":"9223372036854775807"} 2023-09-18 10:03:10,304 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695031390304"}]},"ts":"9223372036854775807"} 2023-09-18 10:03:10,306 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-18 10:03:10,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e98539fae6e48ccd1b87905377f17712, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695031375039.e98539fae6e48ccd1b87905377f17712.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6601bcc52f0dff4b4d8d1b37c6ac6590, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695031375039.6601bcc52f0dff4b4d8d1b37c6ac6590.', STARTKEY => '1', ENDKEY => ''}] 2023-09-18 10:03:10,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-18 10:03:10,306 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695031390306"}]},"ts":"9223372036854775807"} 2023-09-18 10:03:10,307 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-18 10:03:10,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-18 10:03:10,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-18 10:03:10,388 INFO [Listener at jenkins-hbase4.apache.org/40259] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-18 10:03:10,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-18 10:03:10,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-18 10:03:10,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34087] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-18 10:03:10,423 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 765), OpenFileDescriptor=909 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=151 (was 194), ProcessCount=167 (was 167), AvailableMemoryMB=7835 (was 7930) 2023-09-18 10:03:10,423 WARN [Listener at jenkins-hbase4.apache.org/40259] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-18 10:03:10,424 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-18 10:03:10,434 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-18 10:03:14,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695031282809_0007_000001 (auth:SIMPLE) 2023-09-18 10:03:15,714 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-18 10:03:24,557 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-18 10:03:38,670 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-18 10:03:38,671 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-18 10:03:38,778 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-18 10:03:38,786 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-18 10:03:38,787 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-18 10:03:38,793 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-18 10:03:38,896 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-18 10:03:38,896 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-18 10:03:38,896 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-18 10:03:38,896 INFO [Listener at jenkins-hbase4.apache.org/40259] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-18 10:03:38,896 DEBUG [Listener at jenkins-hbase4.apache.org/40259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5773f6d0 to 127.0.0.1:57492 2023-09-18 10:03:38,897 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:38,897 DEBUG [Listener at jenkins-hbase4.apache.org/40259] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-18 10:03:38,897 DEBUG [Listener at jenkins-hbase4.apache.org/40259] util.JVMClusterUtil(257): Found active master hash=575097186, stopped=false 2023-09-18 10:03:38,897 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:38,898 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-18 10:03:38,898 INFO [Listener at jenkins-hbase4.apache.org/40259] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:03:38,899 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-18 10:03:38,899 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-18 10:03:38,899 INFO [Listener at jenkins-hbase4.apache.org/40259] procedure2.ProcedureExecutor(628): Stopping 2023-09-18 10:03:38,899 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-18 10:03:38,899 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-18 10:03:38,899 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:03:38,899 DEBUG [Listener at jenkins-hbase4.apache.org/40259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b2db392 to 127.0.0.1:57492 2023-09-18 10:03:38,899 DEBUG [Listener at jenkins-hbase4.apache.org/40259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:38,899 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34469,1695031276191' ***** 2023-09-18 10:03:38,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:03:38,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:03:38,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:03:38,900 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:38,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-18 10:03:38,900 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-18 10:03:38,900 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33575,1695031276250' ***** 2023-09-18 10:03:38,900 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:38,900 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-18 10:03:38,900 INFO [RS:0;jenkins-hbase4:34469] regionserver.HeapMemoryManager(220): Stopping 2023-09-18 10:03:38,900 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45923,1695031276292' ***** 2023-09-18 10:03:38,900 INFO [RS:1;jenkins-hbase4:33575] regionserver.HeapMemoryManager(220): Stopping 2023-09-18 10:03:38,900 INFO [RS:0;jenkins-hbase4:34469] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-18 10:03:38,900 DEBUG [Listener at jenkins-hbase4.apache.org/40259] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:38,901 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-18 10:03:38,901 INFO [Listener at jenkins-hbase4.apache.org/40259] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-18 10:03:38,901 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-18 10:03:38,901 INFO [RS:0;jenkins-hbase4:34469] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-18 10:03:38,901 INFO [RS:1;jenkins-hbase4:33575] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-18 10:03:38,901 INFO [RS:1;jenkins-hbase4:33575] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-18 10:03:38,901 INFO [RS:2;jenkins-hbase4:45923] regionserver.HeapMemoryManager(220): Stopping 2023-09-18 10:03:38,901 INFO [RS:2;jenkins-hbase4:45923] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-18 10:03:38,901 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(3305): Received CLOSE for 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:03:38,901 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(3305): Received CLOSE for 083ae49f63cd23321343d618bec16700 2023-09-18 10:03:38,901 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-18 10:03:38,901 INFO [RS:2;jenkins-hbase4:45923] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-18 10:03:38,901 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:03:38,901 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:03:38,901 DEBUG [RS:2;jenkins-hbase4:45923] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1be1f3c3 to 127.0.0.1:57492 2023-09-18 10:03:38,901 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:03:38,901 DEBUG [RS:2;jenkins-hbase4:45923] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:38,901 DEBUG [RS:1;jenkins-hbase4:33575] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62f1e446 to 127.0.0.1:57492 2023-09-18 10:03:38,905 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-18 10:03:38,905 DEBUG [RS:1;jenkins-hbase4:33575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:38,905 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-18 10:03:38,905 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-18 10:03:38,905 INFO [RS:1;jenkins-hbase4:33575] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-18 10:03:38,905 INFO [RS:1;jenkins-hbase4:33575] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-18 10:03:38,905 INFO [RS:1;jenkins-hbase4:33575] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-18 10:03:38,905 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45923,1695031276292; all regions closed. 2023-09-18 10:03:38,905 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-18 10:03:38,902 DEBUG [RS:0;jenkins-hbase4:34469] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x747b59c8 to 127.0.0.1:57492 2023-09-18 10:03:38,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 083ae49f63cd23321343d618bec16700, disabling compactions & flushes 2023-09-18 10:03:38,906 DEBUG [RS:0;jenkins-hbase4:34469] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:38,902 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9d4929b98c755e66e6710ea7841b0caf, disabling compactions & flushes 2023-09-18 10:03:38,906 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-18 10:03:38,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:03:38,906 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1478): Online Regions={9d4929b98c755e66e6710ea7841b0caf=hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf.} 2023-09-18 10:03:38,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:03:38,906 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-18 10:03:38,906 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:03:38,907 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 083ae49f63cd23321343d618bec16700=hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700.} 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-18 10:03:38,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. after waiting 0 ms 2023-09-18 10:03:38,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. after waiting 0 ms 2023-09-18 10:03:38,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9d4929b98c755e66e6710ea7841b0caf 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-18 10:03:38,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:03:38,907 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-18 10:03:38,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 083ae49f63cd23321343d618bec16700 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-18 10:03:38,908 DEBUG [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1504): Waiting on 9d4929b98c755e66e6710ea7841b0caf 2023-09-18 10:03:38,908 DEBUG [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1504): Waiting on 083ae49f63cd23321343d618bec16700, 1588230740 2023-09-18 10:03:38,922 DEBUG [RS:2;jenkins-hbase4:45923] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs 2023-09-18 10:03:38,922 INFO [RS:2;jenkins-hbase4:45923] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45923%2C1695031276292:(num 1695031277966) 2023-09-18 10:03:38,922 DEBUG [RS:2;jenkins-hbase4:45923] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:38,922 INFO [RS:2;jenkins-hbase4:45923] regionserver.LeaseManager(133): Closed leases 2023-09-18 10:03:38,923 INFO [RS:2;jenkins-hbase4:45923] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-18 10:03:38,923 INFO [RS:2;jenkins-hbase4:45923] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-18 10:03:38,923 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-18 10:03:38,923 INFO [RS:2;jenkins-hbase4:45923] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-18 10:03:38,923 INFO [RS:2;jenkins-hbase4:45923] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-18 10:03:38,932 INFO [RS:2;jenkins-hbase4:45923] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45923 2023-09-18 10:03:38,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/.tmp/l/57621d8eef3c4e73ac42371b10cf4ee4 2023-09-18 10:03:38,935 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/.tmp/info/0af3c71392964ec1a838bd5c4fea546d 2023-09-18 10:03:38,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/.tmp/info/2ce03ca0839e459d8d27c096818a3dac 2023-09-18 10:03:38,941 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0af3c71392964ec1a838bd5c4fea546d 2023-09-18 10:03:38,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:03:38,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:03:38,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:03:38,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:03:38,941 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45923,1695031276292 2023-09-18 10:03:38,942 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:03:38,942 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:03:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/.tmp/info/2ce03ca0839e459d8d27c096818a3dac as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/info/2ce03ca0839e459d8d27c096818a3dac 2023-09-18 10:03:38,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57621d8eef3c4e73ac42371b10cf4ee4 2023-09-18 10:03:38,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/.tmp/l/57621d8eef3c4e73ac42371b10cf4ee4 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/l/57621d8eef3c4e73ac42371b10cf4ee4 2023-09-18 10:03:38,944 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45923,1695031276292] 2023-09-18 10:03:38,945 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45923,1695031276292; numProcessing=1 2023-09-18 10:03:38,946 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45923,1695031276292 already deleted, retry=false 2023-09-18 10:03:38,946 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45923,1695031276292 expired; onlineServers=2 2023-09-18 10:03:38,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/info/2ce03ca0839e459d8d27c096818a3dac, entries=2, sequenceid=6, filesize=4.8 K 2023-09-18 10:03:38,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 083ae49f63cd23321343d618bec16700 in 42ms, sequenceid=6, compaction requested=false 2023-09-18 10:03:38,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 57621d8eef3c4e73ac42371b10cf4ee4 2023-09-18 10:03:38,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/l/57621d8eef3c4e73ac42371b10cf4ee4, entries=7, sequenceid=18, filesize=5.2 K 2023-09-18 10:03:38,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 9d4929b98c755e66e6710ea7841b0caf in 46ms, sequenceid=18, compaction requested=false 2023-09-18 10:03:38,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/namespace/083ae49f63cd23321343d618bec16700/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-18 10:03:38,958 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:38,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:03:38,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 083ae49f63cd23321343d618bec16700: 2023-09-18 10:03:38,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695031278447.083ae49f63cd23321343d618bec16700. 2023-09-18 10:03:38,959 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/.tmp/rep_barrier/508b7df6e64142758155cfd6ef5cd348 2023-09-18 10:03:38,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/acl/9d4929b98c755e66e6710ea7841b0caf/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-18 10:03:38,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:38,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:03:38,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9d4929b98c755e66e6710ea7841b0caf: 2023-09-18 10:03:38,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695031279285.9d4929b98c755e66e6710ea7841b0caf. 2023-09-18 10:03:38,963 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 508b7df6e64142758155cfd6ef5cd348 2023-09-18 10:03:38,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/.tmp/table/2c658fdc907e41608257cff2a5683db8 2023-09-18 10:03:38,977 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c658fdc907e41608257cff2a5683db8 2023-09-18 10:03:38,978 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/.tmp/info/0af3c71392964ec1a838bd5c4fea546d as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/info/0af3c71392964ec1a838bd5c4fea546d 2023-09-18 10:03:38,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0af3c71392964ec1a838bd5c4fea546d 2023-09-18 10:03:38,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/info/0af3c71392964ec1a838bd5c4fea546d, entries=48, sequenceid=131, filesize=10.3 K 2023-09-18 10:03:38,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/.tmp/rep_barrier/508b7df6e64142758155cfd6ef5cd348 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/rep_barrier/508b7df6e64142758155cfd6ef5cd348 2023-09-18 10:03:38,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 508b7df6e64142758155cfd6ef5cd348 2023-09-18 10:03:38,988 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/rep_barrier/508b7df6e64142758155cfd6ef5cd348, entries=13, sequenceid=131, filesize=6.4 K 2023-09-18 10:03:38,989 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/.tmp/table/2c658fdc907e41608257cff2a5683db8 as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/table/2c658fdc907e41608257cff2a5683db8 2023-09-18 10:03:38,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c658fdc907e41608257cff2a5683db8 2023-09-18 10:03:38,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/table/2c658fdc907e41608257cff2a5683db8, entries=24, sequenceid=131, filesize=6.9 K 2023-09-18 10:03:38,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 87ms, sequenceid=131, compaction requested=false 2023-09-18 10:03:39,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-18 10:03:39,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-18 10:03:39,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-18 10:03:39,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-18 10:03:39,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-18 10:03:39,009 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-18 10:03:39,044 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,044 INFO [RS:2;jenkins-hbase4:45923] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45923,1695031276292; zookeeper connection closed. 2023-09-18 10:03:39,044 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:45923-0x100be7be17d0003, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,045 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22e5d497] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22e5d497 2023-09-18 10:03:39,108 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34469,1695031276191; all regions closed. 2023-09-18 10:03:39,108 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33575,1695031276250; all regions closed. 2023-09-18 10:03:39,116 DEBUG [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs 2023-09-18 10:03:39,116 INFO [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33575%2C1695031276250.meta:.meta(num 1695031278161) 2023-09-18 10:03:39,116 DEBUG [RS:0;jenkins-hbase4:34469] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs 2023-09-18 10:03:39,116 INFO [RS:0;jenkins-hbase4:34469] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34469%2C1695031276191:(num 1695031277966) 2023-09-18 10:03:39,116 DEBUG [RS:0;jenkins-hbase4:34469] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:39,116 INFO [RS:0;jenkins-hbase4:34469] regionserver.LeaseManager(133): Closed leases 2023-09-18 10:03:39,116 INFO [RS:0;jenkins-hbase4:34469] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-18 10:03:39,117 INFO [RS:0;jenkins-hbase4:34469] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-18 10:03:39,117 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-18 10:03:39,117 INFO [RS:0;jenkins-hbase4:34469] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-18 10:03:39,117 INFO [RS:0;jenkins-hbase4:34469] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-18 10:03:39,119 INFO [RS:0;jenkins-hbase4:34469] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34469 2023-09-18 10:03:39,121 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:03:39,121 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34469,1695031276191 2023-09-18 10:03:39,121 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:03:39,123 DEBUG [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/oldWALs 2023-09-18 10:03:39,123 INFO [RS:1;jenkins-hbase4:33575] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33575%2C1695031276250:(num 1695031277966) 2023-09-18 10:03:39,123 DEBUG [RS:1;jenkins-hbase4:33575] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:39,123 INFO [RS:1;jenkins-hbase4:33575] regionserver.LeaseManager(133): Closed leases 2023-09-18 10:03:39,123 INFO [RS:1;jenkins-hbase4:33575] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-18 10:03:39,123 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-18 10:03:39,124 INFO [RS:1;jenkins-hbase4:33575] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33575 2023-09-18 10:03:39,125 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34469,1695031276191] 2023-09-18 10:03:39,125 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34469,1695031276191; numProcessing=2 2023-09-18 10:03:39,125 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-18 10:03:39,125 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33575,1695031276250 2023-09-18 10:03:39,126 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34469,1695031276191 already deleted, retry=false 2023-09-18 10:03:39,126 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34469,1695031276191 expired; onlineServers=1 2023-09-18 10:03:39,127 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33575,1695031276250] 2023-09-18 10:03:39,127 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33575,1695031276250; numProcessing=3 2023-09-18 10:03:39,130 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33575,1695031276250 already deleted, retry=false 2023-09-18 10:03:39,130 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33575,1695031276250 expired; onlineServers=0 2023-09-18 10:03:39,130 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34087,1695031274865' ***** 2023-09-18 10:03:39,130 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-18 10:03:39,130 DEBUG [M:0;jenkins-hbase4:34087] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@637a4359, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-18 10:03:39,130 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34087,1695031274865 2023-09-18 10:03:39,130 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34087,1695031274865; all regions closed. 2023-09-18 10:03:39,130 DEBUG [M:0;jenkins-hbase4:34087] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-18 10:03:39,130 DEBUG [M:0;jenkins-hbase4:34087] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-18 10:03:39,130 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-18 10:03:39,130 DEBUG [M:0;jenkins-hbase4:34087] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-18 10:03:39,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695031277596] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695031277596,5,FailOnTimeoutGroup] 2023-09-18 10:03:39,131 INFO [M:0;jenkins-hbase4:34087] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-18 10:03:39,131 INFO [M:0;jenkins-hbase4:34087] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-18 10:03:39,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695031277597] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695031277597,5,FailOnTimeoutGroup] 2023-09-18 10:03:39,131 INFO [M:0;jenkins-hbase4:34087] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-18 10:03:39,131 DEBUG [M:0;jenkins-hbase4:34087] master.HMaster(1512): Stopping service threads 2023-09-18 10:03:39,131 INFO [M:0;jenkins-hbase4:34087] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-18 10:03:39,131 ERROR [M:0;jenkins-hbase4:34087] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-18 10:03:39,131 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-18 10:03:39,132 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-18 10:03:39,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-18 10:03:39,132 INFO [M:0;jenkins-hbase4:34087] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-18 10:03:39,132 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-18 10:03:39,132 DEBUG [M:0;jenkins-hbase4:34087] zookeeper.ZKUtil(398): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-18 10:03:39,133 WARN [M:0;jenkins-hbase4:34087] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-18 10:03:39,133 INFO [M:0;jenkins-hbase4:34087] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-18 10:03:39,133 INFO [M:0;jenkins-hbase4:34087] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-18 10:03:39,133 DEBUG [M:0;jenkins-hbase4:34087] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-18 10:03:39,134 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:03:39,134 DEBUG [M:0;jenkins-hbase4:34087] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:03:39,134 DEBUG [M:0;jenkins-hbase4:34087] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-18 10:03:39,134 DEBUG [M:0;jenkins-hbase4:34087] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:03:39,134 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.63 KB heapSize=451.88 KB 2023-09-18 10:03:39,152 INFO [M:0;jenkins-hbase4:34087] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.63 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b77a2483b0ff4ae39ba580e761aa44aa 2023-09-18 10:03:39,156 INFO [M:0;jenkins-hbase4:34087] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b77a2483b0ff4ae39ba580e761aa44aa 2023-09-18 10:03:39,157 DEBUG [M:0;jenkins-hbase4:34087] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/b77a2483b0ff4ae39ba580e761aa44aa as hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b77a2483b0ff4ae39ba580e761aa44aa 2023-09-18 10:03:39,161 INFO [M:0;jenkins-hbase4:34087] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b77a2483b0ff4ae39ba580e761aa44aa 2023-09-18 10:03:39,161 INFO [M:0;jenkins-hbase4:34087] regionserver.HStore(1080): Added hdfs://localhost:44901/user/jenkins/test-data/df1bad77-01bd-274a-2059-b58b4bd61268/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/b77a2483b0ff4ae39ba580e761aa44aa, entries=119, sequenceid=899, filesize=28.6 K 2023-09-18 10:03:39,163 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegion(2948): Finished flush of dataSize ~375.63 KB/384642, heapSize ~451.86 KB/462704, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 29ms, sequenceid=899, compaction requested=false 2023-09-18 10:03:39,165 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-18 10:03:39,165 DEBUG [M:0;jenkins-hbase4:34087] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-18 10:03:39,169 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-18 10:03:39,169 INFO [M:0;jenkins-hbase4:34087] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-18 10:03:39,169 INFO [M:0;jenkins-hbase4:34087] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34087 2023-09-18 10:03:39,171 DEBUG [M:0;jenkins-hbase4:34087] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34087,1695031274865 already deleted, retry=false 2023-09-18 10:03:39,225 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,225 INFO [RS:0;jenkins-hbase4:34469] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34469,1695031276191; zookeeper connection closed. 2023-09-18 10:03:39,225 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:34469-0x100be7be17d0001, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,225 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2dfc63ab] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2dfc63ab 2023-09-18 10:03:39,325 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,325 INFO [M:0;jenkins-hbase4:34087] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34087,1695031274865; zookeeper connection closed. 2023-09-18 10:03:39,325 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): master:34087-0x100be7be17d0000, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,426 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,426 INFO [RS:1;jenkins-hbase4:33575] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33575,1695031276250; zookeeper connection closed. 2023-09-18 10:03:39,426 DEBUG [Listener at localhost/42845-EventThread] zookeeper.ZKWatcher(600): regionserver:33575-0x100be7be17d0002, quorum=127.0.0.1:57492, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-18 10:03:39,426 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@73f2ec29] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@73f2ec29 2023-09-18 10:03:39,426 INFO [Listener at jenkins-hbase4.apache.org/40259] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-18 10:03:39,427 WARN [Listener at jenkins-hbase4.apache.org/40259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-18 10:03:39,430 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-18 10:03:39,533 WARN [BP-676995621-172.31.14.131-1695031271128 heartbeating to localhost/127.0.0.1:44901] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-18 10:03:39,533 WARN [BP-676995621-172.31.14.131-1695031271128 heartbeating to localhost/127.0.0.1:44901] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-676995621-172.31.14.131-1695031271128 (Datanode Uuid 49b7499c-7eb9-4c66-8493-18afc0b5702e) service to localhost/127.0.0.1:44901 2023-09-18 10:03:39,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data5/current/BP-676995621-172.31.14.131-1695031271128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-18 10:03:39,536 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data6/current/BP-676995621-172.31.14.131-1695031271128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-18 10:03:39,537 WARN [Listener at jenkins-hbase4.apache.org/40259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-18 10:03:39,539 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-18 10:03:39,642 WARN [BP-676995621-172.31.14.131-1695031271128 heartbeating to localhost/127.0.0.1:44901] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-18 10:03:39,643 WARN [BP-676995621-172.31.14.131-1695031271128 heartbeating to localhost/127.0.0.1:44901] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-676995621-172.31.14.131-1695031271128 (Datanode Uuid 4d03d732-543d-466f-b418-11a6a0b34019) service to localhost/127.0.0.1:44901 2023-09-18 10:03:39,643 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data3/current/BP-676995621-172.31.14.131-1695031271128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-18 10:03:39,643 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data4/current/BP-676995621-172.31.14.131-1695031271128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-18 10:03:39,644 WARN [Listener at jenkins-hbase4.apache.org/40259] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-18 10:03:39,646 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-18 10:03:39,750 WARN [BP-676995621-172.31.14.131-1695031271128 heartbeating to localhost/127.0.0.1:44901] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-18 10:03:39,750 WARN [BP-676995621-172.31.14.131-1695031271128 heartbeating to localhost/127.0.0.1:44901] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-676995621-172.31.14.131-1695031271128 (Datanode Uuid f2be06be-dadf-4fb4-bdd3-5827c973fe33) service to localhost/127.0.0.1:44901 2023-09-18 10:03:39,751 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data1/current/BP-676995621-172.31.14.131-1695031271128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-18 10:03:39,752 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/276dfd78-ccd4-7235-51fc-07b98e4d9355/cluster_12ee3cee-d660-3373-016e-b6c168b0e9f6/dfs/data/data2/current/BP-676995621-172.31.14.131-1695031271128] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-18 10:03:39,772 INFO [Listener at jenkins-hbase4.apache.org/40259] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-18 10:03:39,898 INFO [Listener at jenkins-hbase4.apache.org/40259] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-18 10:03:39,983 INFO [Listener at jenkins-hbase4.apache.org/40259] hbase.HBaseTestingUtility(1293): Minicluster is down