2023-07-11 20:12:34,459 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-11 20:12:34,746 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc 2023-07-11 20:12:34,747 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-11 20:12:34,747 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-11 20:12:34,787 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-11 20:12:35,045 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-11 20:12:35,045 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b, deleteOnExit=true 2023-07-11 20:12:35,046 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-11 20:12:35,046 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/test.cache.data in system properties and HBase conf 2023-07-11 20:12:35,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 20:12:35,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop.log.dir in system properties and HBase conf 2023-07-11 20:12:35,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 20:12:35,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 20:12:35,049 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 20:12:35,429 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-11 20:12:35,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:35,435 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:35,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 20:12:35,436 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:35,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 20:12:35,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 20:12:35,437 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:35,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:35,438 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 20:12:35,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/nfs.dump.dir in system properties and HBase conf 2023-07-11 20:12:35,439 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir in system properties and HBase conf 2023-07-11 20:12:35,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:35,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 20:12:35,440 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-11 20:12:36,040 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 20:12:36,044 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 20:12:36,341 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-11 20:12:36,533 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-11 20:12:36,550 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:36,588 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:36,620 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_localhost_44289_hdfs____.h8wbab/webapp 2023-07-11 20:12:36,780 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44289 2023-07-11 20:12:36,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-11 20:12:36,820 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-11 20:12:37,352 WARN [Listener at localhost/44579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:37,456 WARN [Listener at localhost/44579] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:12:37,480 WARN [Listener at localhost/44579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:37,489 INFO [Listener at localhost/44579] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:37,497 INFO [Listener at localhost/44579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_localhost_43009_datanode____f63nep/webapp 2023-07-11 20:12:37,647 INFO [Listener at localhost/44579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43009 2023-07-11 20:12:38,164 WARN [Listener at localhost/34721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:38,209 WARN [Listener at localhost/34721] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:12:38,213 WARN [Listener at localhost/34721] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:38,215 INFO [Listener at localhost/34721] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:38,223 INFO [Listener at localhost/34721] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_localhost_33941_datanode____9gjmd9/webapp 2023-07-11 20:12:38,350 INFO [Listener at localhost/34721] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33941 2023-07-11 20:12:38,368 WARN [Listener at localhost/41573] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:38,473 WARN [Listener at localhost/41573] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-11 20:12:38,487 WARN [Listener at localhost/41573] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:38,490 INFO [Listener at localhost/41573] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:38,509 INFO [Listener at localhost/41573] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_localhost_42495_datanode____.3j1x53/webapp 2023-07-11 20:12:38,663 INFO [Listener at localhost/41573] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42495 2023-07-11 20:12:38,753 WARN [Listener at localhost/39111] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-11 20:12:38,893 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x75297b3daa36a888: Processing first storage report for DS-b3723905-12c4-4777-91b4-185e35346c78 from datanode 693cf224-9e0e-4942-94de-4e07b29ca66e 2023-07-11 20:12:38,895 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x75297b3daa36a888: from storage DS-b3723905-12c4-4777-91b4-185e35346c78 node DatanodeRegistration(127.0.0.1:34733, datanodeUuid=693cf224-9e0e-4942-94de-4e07b29ca66e, infoPort=42181, infoSecurePort=0, ipcPort=41573, storageInfo=lv=-57;cid=testClusterID;nsid=1185812747;c=1689106356113), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,896 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a3c62e12db617b9: Processing first storage report for DS-46522fa0-8e5e-4493-81b3-994de49f7bdb from datanode 8bdf6493-1666-4b4e-9182-078f2e2d5a4a 2023-07-11 20:12:38,896 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a3c62e12db617b9: from storage DS-46522fa0-8e5e-4493-81b3-994de49f7bdb node DatanodeRegistration(127.0.0.1:33985, datanodeUuid=8bdf6493-1666-4b4e-9182-078f2e2d5a4a, infoPort=36397, infoSecurePort=0, ipcPort=34721, storageInfo=lv=-57;cid=testClusterID;nsid=1185812747;c=1689106356113), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,896 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x75297b3daa36a888: Processing first storage report for DS-2afe8387-9f5c-4c99-969e-7ecdc54f5406 from datanode 693cf224-9e0e-4942-94de-4e07b29ca66e 2023-07-11 20:12:38,897 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x75297b3daa36a888: from storage DS-2afe8387-9f5c-4c99-969e-7ecdc54f5406 node DatanodeRegistration(127.0.0.1:34733, datanodeUuid=693cf224-9e0e-4942-94de-4e07b29ca66e, infoPort=42181, infoSecurePort=0, ipcPort=41573, storageInfo=lv=-57;cid=testClusterID;nsid=1185812747;c=1689106356113), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,897 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4a3c62e12db617b9: Processing first storage report for DS-05d20118-eb37-4497-8dcf-dcda8bd34b80 from datanode 8bdf6493-1666-4b4e-9182-078f2e2d5a4a 2023-07-11 20:12:38,897 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4a3c62e12db617b9: from storage DS-05d20118-eb37-4497-8dcf-dcda8bd34b80 node DatanodeRegistration(127.0.0.1:33985, datanodeUuid=8bdf6493-1666-4b4e-9182-078f2e2d5a4a, infoPort=36397, infoSecurePort=0, ipcPort=34721, storageInfo=lv=-57;cid=testClusterID;nsid=1185812747;c=1689106356113), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,944 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x194b0beef1b6cac2: Processing first storage report for DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e from datanode bfc2094f-80a9-4f11-b272-58e939c2b448 2023-07-11 20:12:38,944 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x194b0beef1b6cac2: from storage DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e node DatanodeRegistration(127.0.0.1:40671, datanodeUuid=bfc2094f-80a9-4f11-b272-58e939c2b448, infoPort=33959, infoSecurePort=0, ipcPort=39111, storageInfo=lv=-57;cid=testClusterID;nsid=1185812747;c=1689106356113), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:38,944 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x194b0beef1b6cac2: Processing first storage report for DS-0a92519a-ea48-4d01-850b-1e74b6a49d98 from datanode bfc2094f-80a9-4f11-b272-58e939c2b448 2023-07-11 20:12:38,944 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x194b0beef1b6cac2: from storage DS-0a92519a-ea48-4d01-850b-1e74b6a49d98 node DatanodeRegistration(127.0.0.1:40671, datanodeUuid=bfc2094f-80a9-4f11-b272-58e939c2b448, infoPort=33959, infoSecurePort=0, ipcPort=39111, storageInfo=lv=-57;cid=testClusterID;nsid=1185812747;c=1689106356113), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-11 20:12:39,217 DEBUG [Listener at localhost/39111] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc 2023-07-11 20:12:39,307 INFO [Listener at localhost/39111] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/zookeeper_0, clientPort=53621, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-11 20:12:39,335 INFO [Listener at localhost/39111] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53621 2023-07-11 20:12:39,347 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:39,350 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:40,081 INFO [Listener at localhost/39111] util.FSUtils(471): Created version file at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 with version=8 2023-07-11 20:12:40,081 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/hbase-staging 2023-07-11 20:12:40,458 INFO [Listener at localhost/39111] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-11 20:12:41,162 INFO [Listener at localhost/39111] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:41,202 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,203 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,203 INFO [Listener at localhost/39111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:41,203 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,203 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:41,401 INFO [Listener at localhost/39111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:41,481 DEBUG [Listener at localhost/39111] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-11 20:12:41,596 INFO [Listener at localhost/39111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36627 2023-07-11 20:12:41,610 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,613 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,643 INFO [Listener at localhost/39111] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36627 connecting to ZooKeeper ensemble=127.0.0.1:53621 2023-07-11 20:12:41,708 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:366270x0, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:41,714 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36627-0x101560426f70000 connected 2023-07-11 20:12:41,766 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:41,767 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:41,790 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:41,801 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36627 2023-07-11 20:12:41,802 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36627 2023-07-11 20:12:41,804 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36627 2023-07-11 20:12:41,807 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36627 2023-07-11 20:12:41,810 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36627 2023-07-11 20:12:41,819 INFO [Listener at localhost/39111] master.HMaster(444): hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, hbase.cluster.distributed=false 2023-07-11 20:12:41,916 INFO [Listener at localhost/39111] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:41,917 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,917 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,917 INFO [Listener at localhost/39111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:41,917 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:41,918 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:41,925 INFO [Listener at localhost/39111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:41,931 INFO [Listener at localhost/39111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40513 2023-07-11 20:12:41,935 INFO [Listener at localhost/39111] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:12:41,950 INFO [Listener at localhost/39111] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 20:12:41,952 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,954 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:41,956 INFO [Listener at localhost/39111] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40513 connecting to ZooKeeper ensemble=127.0.0.1:53621 2023-07-11 20:12:41,969 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:405130x0, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:41,971 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:405130x0, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:41,973 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40513-0x101560426f70001 connected 2023-07-11 20:12:41,973 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:41,974 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:41,981 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40513 2023-07-11 20:12:41,982 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40513 2023-07-11 20:12:41,982 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40513 2023-07-11 20:12:41,988 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40513 2023-07-11 20:12:41,994 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40513 2023-07-11 20:12:42,015 INFO [Listener at localhost/39111] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:42,015 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:42,016 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:42,016 INFO [Listener at localhost/39111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:42,016 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:42,017 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:42,017 INFO [Listener at localhost/39111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:42,018 INFO [Listener at localhost/39111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46707 2023-07-11 20:12:42,019 INFO [Listener at localhost/39111] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:12:42,021 INFO [Listener at localhost/39111] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 20:12:42,022 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:42,024 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:42,027 INFO [Listener at localhost/39111] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46707 connecting to ZooKeeper ensemble=127.0.0.1:53621 2023-07-11 20:12:42,042 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:467070x0, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:42,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46707-0x101560426f70002 connected 2023-07-11 20:12:42,044 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:42,045 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:42,048 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:42,059 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46707 2023-07-11 20:12:42,066 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46707 2023-07-11 20:12:42,071 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46707 2023-07-11 20:12:42,077 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46707 2023-07-11 20:12:42,077 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46707 2023-07-11 20:12:42,092 INFO [Listener at localhost/39111] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-11 20:12:42,093 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:42,093 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:42,093 INFO [Listener at localhost/39111] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-11 20:12:42,093 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-11 20:12:42,094 INFO [Listener at localhost/39111] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-11 20:12:42,094 INFO [Listener at localhost/39111] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-11 20:12:42,096 INFO [Listener at localhost/39111] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43979 2023-07-11 20:12:42,096 INFO [Listener at localhost/39111] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-11 20:12:42,099 INFO [Listener at localhost/39111] mob.MobFileCache(124): MobFileCache disabled 2023-07-11 20:12:42,101 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:42,103 INFO [Listener at localhost/39111] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:42,106 INFO [Listener at localhost/39111] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43979 connecting to ZooKeeper ensemble=127.0.0.1:53621 2023-07-11 20:12:42,109 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:439790x0, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-11 20:12:42,111 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:439790x0, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:12:42,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43979-0x101560426f70003 connected 2023-07-11 20:12:42,112 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:12:42,113 DEBUG [Listener at localhost/39111] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-11 20:12:42,114 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43979 2023-07-11 20:12:42,115 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43979 2023-07-11 20:12:42,116 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43979 2023-07-11 20:12:42,119 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43979 2023-07-11 20:12:42,119 DEBUG [Listener at localhost/39111] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43979 2023-07-11 20:12:42,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:42,135 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 20:12:42,137 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:42,160 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,160 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,160 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,161 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:42,160 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-11 20:12:42,163 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 20:12:42,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-11 20:12:42,164 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36627,1689106360268 from backup master directory 2023-07-11 20:12:42,170 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:42,170 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-11 20:12:42,171 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:42,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:42,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-11 20:12:42,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-11 20:12:42,290 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/hbase.id with ID: 93aab416-02a8-4a90-973c-00e204d7a15f 2023-07-11 20:12:42,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-11 20:12:42,354 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:42,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c495bfa to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:42,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@579e0079, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:42,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:42,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-11 20:12:42,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-11 20:12:42,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-11 20:12:42,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:12:42,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:12:42,513 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:42,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store-tmp 2023-07-11 20:12:42,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:42,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 20:12:42,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 20:12:42,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:12:42,611 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:12:42,614 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/WALs/jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:42,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36627%2C1689106360268, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/WALs/jenkins-hbase4.apache.org,36627,1689106360268, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/oldWALs, maxLogs=10 2023-07-11 20:12:42,752 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK] 2023-07-11 20:12:42,756 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK] 2023-07-11 20:12:42,752 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK] 2023-07-11 20:12:42,767 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-11 20:12:42,864 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/WALs/jenkins-hbase4.apache.org,36627,1689106360268/jenkins-hbase4.apache.org%2C36627%2C1689106360268.1689106362660 2023-07-11 20:12:42,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK], DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK]] 2023-07-11 20:12:42,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:42,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:42,871 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,873 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,958 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:42,966 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-11 20:12:43,006 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-11 20:12:43,022 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:43,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:43,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-11 20:12:43,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:43,056 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59843958, jitterRate=-0.108255535364151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:43,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:12:43,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-11 20:12:43,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-11 20:12:43,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-11 20:12:43,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-11 20:12:43,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-11 20:12:43,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 42 msec 2023-07-11 20:12:43,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-11 20:12:43,172 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-11 20:12:43,178 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-11 20:12:43,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-11 20:12:43,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-11 20:12:43,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-11 20:12:43,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-11 20:12:43,234 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-11 20:12:43,238 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,240 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-11 20:12:43,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-11 20:12:43,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-11 20:12:43,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-11 20:12:43,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,36627,1689106360268, sessionid=0x101560426f70000, setting cluster-up flag (Was=false) 2023-07-11 20:12:43,279 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-11 20:12:43,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:43,308 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:43,319 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-11 20:12:43,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:43,325 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp 2023-07-11 20:12:43,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-11 20:12:43,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-11 20:12:43,427 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(951): ClusterId : 93aab416-02a8-4a90-973c-00e204d7a15f 2023-07-11 20:12:43,429 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(951): ClusterId : 93aab416-02a8-4a90-973c-00e204d7a15f 2023-07-11 20:12:43,436 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(951): ClusterId : 93aab416-02a8-4a90-973c-00e204d7a15f 2023-07-11 20:12:43,437 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:12:43,438 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:12:43,437 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-11 20:12:43,446 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:12:43,446 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:12:43,449 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:12:43,449 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:12:43,452 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:12:43,454 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:12:43,455 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-11 20:12:43,455 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-11 20:12:43,456 DEBUG [RS:1;jenkins-hbase4:46707] zookeeper.ReadOnlyZKClient(139): Connect 0x29ac7b63 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:43,456 DEBUG [RS:2;jenkins-hbase4:43979] zookeeper.ReadOnlyZKClient(139): Connect 0x72a5cfaa to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:43,461 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-11 20:12:43,475 DEBUG [RS:0;jenkins-hbase4:40513] zookeeper.ReadOnlyZKClient(139): Connect 0x45f53bc5 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:43,493 DEBUG [RS:1;jenkins-hbase4:46707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ddbd7e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:43,494 DEBUG [RS:1;jenkins-hbase4:46707] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@159e7153, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:12:43,530 DEBUG [RS:2;jenkins-hbase4:43979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c623f8e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:43,531 DEBUG [RS:2;jenkins-hbase4:43979] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@785da4da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:12:43,535 DEBUG [RS:0;jenkins-hbase4:40513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8cb48f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:43,536 DEBUG [RS:0;jenkins-hbase4:40513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@105de20b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:12:43,547 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46707 2023-07-11 20:12:43,548 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40513 2023-07-11 20:12:43,554 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43979 2023-07-11 20:12:43,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-11 20:12:43,562 INFO [RS:1;jenkins-hbase4:46707] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:12:43,562 INFO [RS:1;jenkins-hbase4:46707] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:12:43,562 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 20:12:43,564 INFO [RS:0;jenkins-hbase4:40513] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:12:43,564 INFO [RS:0;jenkins-hbase4:40513] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:12:43,564 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 20:12:43,563 INFO [RS:2;jenkins-hbase4:43979] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-11 20:12:43,564 INFO [RS:0;jenkins-hbase4:40513] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,567 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:12:43,564 INFO [RS:1;jenkins-hbase4:46707] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,567 INFO [RS:2;jenkins-hbase4:43979] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-11 20:12:43,568 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-11 20:12:43,568 INFO [RS:2;jenkins-hbase4:43979] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:43,568 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:12:43,567 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1022): About to register with Master. 2023-07-11 20:12:43,571 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36627,1689106360268 with isa=jenkins-hbase4.apache.org/172.31.14.131:43979, startcode=1689106362092 2023-07-11 20:12:43,572 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36627,1689106360268 with isa=jenkins-hbase4.apache.org/172.31.14.131:40513, startcode=1689106361915 2023-07-11 20:12:43,573 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,36627,1689106360268 with isa=jenkins-hbase4.apache.org/172.31.14.131:46707, startcode=1689106362013 2023-07-11 20:12:43,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-11 20:12:43,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-11 20:12:43,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,601 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689106393601 2023-07-11 20:12:43,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-11 20:12:43,613 DEBUG [RS:0;jenkins-hbase4:40513] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:12:43,614 DEBUG [RS:1;jenkins-hbase4:46707] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:12:43,613 DEBUG [RS:2;jenkins-hbase4:43979] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-11 20:12:43,618 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 20:12:43,619 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-11 20:12:43,628 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:43,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-11 20:12:43,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-11 20:12:43,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-11 20:12:43,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-11 20:12:43,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-11 20:12:43,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,670 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-11 20:12:43,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-11 20:12:43,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-11 20:12:43,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-11 20:12:43,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-11 20:12:43,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689106363689,5,FailOnTimeoutGroup] 2023-07-11 20:12:43,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689106363692,5,FailOnTimeoutGroup] 2023-07-11 20:12:43,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-11 20:12:43,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,712 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54859, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:12:43,712 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54631, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:12:43,712 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38159, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-11 20:12:43,744 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36627] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:43,752 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:43,754 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:43,754 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:12:43,763 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36627] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:43,764 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36627] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:43,769 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:12:43,770 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44579 2023-07-11 20:12:43,770 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:12:43,769 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:12:43,771 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44579 2023-07-11 20:12:43,771 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:12:43,780 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:12:43,780 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44579 2023-07-11 20:12:43,780 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-11 20:12:43,784 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:12:43,785 DEBUG [RS:0;jenkins-hbase4:40513] zookeeper.ZKUtil(162): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:43,787 DEBUG [RS:1;jenkins-hbase4:46707] zookeeper.ZKUtil(162): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:43,788 DEBUG [RS:2;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:43,787 WARN [RS:0;jenkins-hbase4:40513] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:43,793 INFO [RS:0;jenkins-hbase4:40513] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:43,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43979,1689106362092] 2023-07-11 20:12:43,793 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:43,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40513,1689106361915] 2023-07-11 20:12:43,793 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46707,1689106362013] 2023-07-11 20:12:43,787 WARN [RS:1;jenkins-hbase4:46707] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:43,788 WARN [RS:2;jenkins-hbase4:43979] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-11 20:12:43,794 INFO [RS:1;jenkins-hbase4:46707] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:43,794 INFO [RS:2;jenkins-hbase4:43979] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:43,798 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:43,798 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:43,832 DEBUG [RS:0;jenkins-hbase4:40513] zookeeper.ZKUtil(162): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:43,835 DEBUG [RS:0;jenkins-hbase4:40513] zookeeper.ZKUtil(162): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:43,835 DEBUG [RS:0;jenkins-hbase4:40513] zookeeper.ZKUtil(162): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:43,844 DEBUG [RS:1;jenkins-hbase4:46707] zookeeper.ZKUtil(162): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:43,844 DEBUG [RS:1;jenkins-hbase4:46707] zookeeper.ZKUtil(162): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:43,845 DEBUG [RS:1;jenkins-hbase4:46707] zookeeper.ZKUtil(162): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:43,846 DEBUG [RS:2;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:43,846 DEBUG [RS:2;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:43,847 DEBUG [RS:2;jenkins-hbase4:43979] zookeeper.ZKUtil(162): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:43,859 DEBUG [RS:0;jenkins-hbase4:40513] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:12:43,859 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:12:43,859 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-11 20:12:43,872 INFO [RS:2;jenkins-hbase4:43979] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:12:43,873 INFO [RS:1;jenkins-hbase4:46707] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:12:43,872 INFO [RS:0;jenkins-hbase4:40513] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-11 20:12:43,876 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:43,886 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:12:43,890 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/info 2023-07-11 20:12:43,891 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:12:43,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:12:43,913 INFO [RS:1;jenkins-hbase4:46707] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:12:43,926 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:12:43,927 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:12:43,935 INFO [RS:2;jenkins-hbase4:43979] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:12:43,936 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,938 INFO [RS:2;jenkins-hbase4:43979] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:12:43,948 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:12:43,948 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,919 INFO [RS:0;jenkins-hbase4:40513] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-11 20:12:43,938 INFO [RS:1;jenkins-hbase4:46707] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:12:43,951 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/table 2023-07-11 20:12:43,952 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:12:43,953 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:43,960 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:12:43,967 INFO [RS:0;jenkins-hbase4:40513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-11 20:12:43,968 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,948 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,961 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740 2023-07-11 20:12:43,970 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740 2023-07-11 20:12:43,974 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:12:43,974 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:12:43,976 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:12:43,980 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-11 20:12:43,983 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:43,986 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67784330, jitterRate=0.010065227746963501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:12:43,986 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:12:43,986 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 20:12:43,987 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 20:12:43,987 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 20:12:43,987 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 20:12:43,987 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 20:12:43,987 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,987 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,987 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,988 DEBUG [RS:1;jenkins-hbase4:46707] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,991 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,987 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,995 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 20:12:43,996 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,996 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 20:12:43,997 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,996 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-11 20:12:43,997 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:0;jenkins-hbase4:40513] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,997 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,998 DEBUG [RS:2;jenkins-hbase4:43979] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-11 20:12:43,998 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,998 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:43,998 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,003 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-11 20:12:44,003 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-11 20:12:44,006 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,007 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,007 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,015 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,015 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,015 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-11 20:12:44,035 INFO [RS:2;jenkins-hbase4:43979] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:12:44,036 INFO [RS:0;jenkins-hbase4:40513] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:12:44,035 INFO [RS:1;jenkins-hbase4:46707] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-11 20:12:44,040 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-11 20:12:44,040 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43979,1689106362092-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,040 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40513,1689106361915-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,040 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46707,1689106362013-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,043 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-11 20:12:44,088 INFO [RS:1;jenkins-hbase4:46707] regionserver.Replication(203): jenkins-hbase4.apache.org,46707,1689106362013 started 2023-07-11 20:12:44,090 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,46707,1689106362013, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46707, sessionid=0x101560426f70002 2023-07-11 20:12:44,096 INFO [RS:2;jenkins-hbase4:43979] regionserver.Replication(203): jenkins-hbase4.apache.org,43979,1689106362092 started 2023-07-11 20:12:44,096 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43979,1689106362092, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43979, sessionid=0x101560426f70003 2023-07-11 20:12:44,106 INFO [RS:0;jenkins-hbase4:40513] regionserver.Replication(203): jenkins-hbase4.apache.org,40513,1689106361915 started 2023-07-11 20:12:44,106 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:12:44,106 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40513,1689106361915, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40513, sessionid=0x101560426f70001 2023-07-11 20:12:44,107 DEBUG [RS:2;jenkins-hbase4:43979] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:44,107 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:12:44,107 DEBUG [RS:2;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43979,1689106362092' 2023-07-11 20:12:44,112 DEBUG [RS:2;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:12:44,107 DEBUG [RS:0;jenkins-hbase4:40513] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:44,112 DEBUG [RS:0;jenkins-hbase4:40513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40513,1689106361915' 2023-07-11 20:12:44,113 DEBUG [RS:0;jenkins-hbase4:40513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:12:44,113 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-11 20:12:44,113 DEBUG [RS:1;jenkins-hbase4:46707] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:44,113 DEBUG [RS:1;jenkins-hbase4:46707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46707,1689106362013' 2023-07-11 20:12:44,113 DEBUG [RS:1;jenkins-hbase4:46707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-11 20:12:44,114 DEBUG [RS:1;jenkins-hbase4:46707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:12:44,114 DEBUG [RS:2;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:12:44,114 DEBUG [RS:0;jenkins-hbase4:40513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-11 20:12:44,115 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:12:44,115 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:12:44,115 DEBUG [RS:1;jenkins-hbase4:46707] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:44,115 DEBUG [RS:1;jenkins-hbase4:46707] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46707,1689106362013' 2023-07-11 20:12:44,115 DEBUG [RS:1;jenkins-hbase4:46707] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:44,123 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:12:44,123 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-11 20:12:44,124 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:12:44,123 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-11 20:12:44,124 DEBUG [RS:2;jenkins-hbase4:43979] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:44,125 DEBUG [RS:2;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43979,1689106362092' 2023-07-11 20:12:44,125 DEBUG [RS:2;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:44,125 DEBUG [RS:0;jenkins-hbase4:40513] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:44,125 DEBUG [RS:0;jenkins-hbase4:40513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40513,1689106361915' 2023-07-11 20:12:44,125 DEBUG [RS:0;jenkins-hbase4:40513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:44,125 DEBUG [RS:2;jenkins-hbase4:43979] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:44,127 DEBUG [RS:1;jenkins-hbase4:46707] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:44,129 DEBUG [RS:0;jenkins-hbase4:40513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:44,129 DEBUG [RS:2;jenkins-hbase4:43979] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:12:44,129 DEBUG [RS:1;jenkins-hbase4:46707] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:12:44,129 INFO [RS:2;jenkins-hbase4:43979] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:12:44,129 INFO [RS:2;jenkins-hbase4:43979] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:12:44,130 DEBUG [RS:0;jenkins-hbase4:40513] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-11 20:12:44,129 INFO [RS:1;jenkins-hbase4:46707] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:12:44,130 INFO [RS:0;jenkins-hbase4:40513] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-11 20:12:44,131 INFO [RS:0;jenkins-hbase4:40513] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:12:44,130 INFO [RS:1;jenkins-hbase4:46707] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-11 20:12:44,198 DEBUG [jenkins-hbase4:36627] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-11 20:12:44,204 DEBUG [jenkins-hbase4:36627] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:44,210 DEBUG [jenkins-hbase4:36627] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:44,210 DEBUG [jenkins-hbase4:36627] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:44,210 DEBUG [jenkins-hbase4:36627] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:44,210 DEBUG [jenkins-hbase4:36627] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:44,213 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46707,1689106362013, state=OPENING 2023-07-11 20:12:44,221 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-11 20:12:44,223 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:44,223 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:12:44,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:12:44,245 INFO [RS:2;jenkins-hbase4:43979] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43979%2C1689106362092, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,43979,1689106362092, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs, maxLogs=32 2023-07-11 20:12:44,246 INFO [RS:0;jenkins-hbase4:40513] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40513%2C1689106361915, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,40513,1689106361915, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs, maxLogs=32 2023-07-11 20:12:44,246 INFO [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46707%2C1689106362013, suffix=, logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,46707,1689106362013, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs, maxLogs=32 2023-07-11 20:12:44,272 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK] 2023-07-11 20:12:44,272 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK] 2023-07-11 20:12:44,274 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK] 2023-07-11 20:12:44,287 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK] 2023-07-11 20:12:44,287 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK] 2023-07-11 20:12:44,303 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK] 2023-07-11 20:12:44,304 INFO [RS:0;jenkins-hbase4:40513] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,40513,1689106361915/jenkins-hbase4.apache.org%2C40513%2C1689106361915.1689106364251 2023-07-11 20:12:44,312 DEBUG [RS:0;jenkins-hbase4:40513] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK]] 2023-07-11 20:12:44,312 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK] 2023-07-11 20:12:44,312 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK] 2023-07-11 20:12:44,312 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK] 2023-07-11 20:12:44,331 INFO [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,46707,1689106362013/jenkins-hbase4.apache.org%2C46707%2C1689106362013.1689106364251 2023-07-11 20:12:44,334 DEBUG [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK]] 2023-07-11 20:12:44,343 INFO [RS:2;jenkins-hbase4:43979] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,43979,1689106362092/jenkins-hbase4.apache.org%2C43979%2C1689106362092.1689106364251 2023-07-11 20:12:44,348 DEBUG [RS:2;jenkins-hbase4:43979] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK]] 2023-07-11 20:12:44,444 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:44,448 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:12:44,456 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:12:44,473 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-11 20:12:44,473 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-11 20:12:44,477 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46707%2C1689106362013.meta, suffix=.meta, logDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,46707,1689106362013, archiveDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs, maxLogs=32 2023-07-11 20:12:44,504 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK] 2023-07-11 20:12:44,505 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK] 2023-07-11 20:12:44,506 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK] 2023-07-11 20:12:44,526 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,46707,1689106362013/jenkins-hbase4.apache.org%2C46707%2C1689106362013.meta.1689106364478.meta 2023-07-11 20:12:44,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40671,DS-1cdc06b0-fc49-4ea7-a0c0-034254e1a22e,DISK], DatanodeInfoWithStorage[127.0.0.1:33985,DS-46522fa0-8e5e-4493-81b3-994de49f7bdb,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-b3723905-12c4-4777-91b4-185e35346c78,DISK]] 2023-07-11 20:12:44,528 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:44,529 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-11 20:12:44,531 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:44,532 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-11 20:12:44,535 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-11 20:12:44,537 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-11 20:12:44,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-11 20:12:44,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:44,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-11 20:12:44,554 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-11 20:12:44,563 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-11 20:12:44,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/info 2023-07-11 20:12:44,567 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/info 2023-07-11 20:12:44,568 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-11 20:12:44,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:44,569 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-11 20:12:44,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:12:44,571 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/rep_barrier 2023-07-11 20:12:44,572 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-11 20:12:44,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:44,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-11 20:12:44,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/table 2023-07-11 20:12:44,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/table 2023-07-11 20:12:44,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-11 20:12:44,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:44,578 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740 2023-07-11 20:12:44,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740 2023-07-11 20:12:44,586 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-11 20:12:44,589 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-11 20:12:44,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66469887, jitterRate=-0.009521499276161194}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-11 20:12:44,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-11 20:12:44,607 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689106364435 2023-07-11 20:12:44,632 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-11 20:12:44,633 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-11 20:12:44,636 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46707,1689106362013, state=OPEN 2023-07-11 20:12:44,639 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-11 20:12:44,639 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-11 20:12:44,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-11 20:12:44,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46707,1689106362013 in 411 msec 2023-07-11 20:12:44,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-11 20:12:44,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 631 msec 2023-07-11 20:12:44,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2390 sec 2023-07-11 20:12:44,667 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689106364667, completionTime=-1 2023-07-11 20:12:44,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-11 20:12:44,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-11 20:12:44,749 DEBUG [hconnection-0x7a631db2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:44,756 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:44,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-11 20:12:44,786 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689106424786 2023-07-11 20:12:44,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689106484787 2023-07-11 20:12:44,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 118 msec 2023-07-11 20:12:44,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36627,1689106360268-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36627,1689106360268-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36627,1689106360268-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36627, period=300000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-11 20:12:44,835 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-11 20:12:44,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-11 20:12:44,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:44,852 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-11 20:12:44,859 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:12:44,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:12:44,895 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:44,898 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3 empty. 2023-07-11 20:12:44,899 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:44,899 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-11 20:12:44,975 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:44,978 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2b8f46affab8347acb03d8216f633c3, NAME => 'hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:12:45,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:45,006 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a2b8f46affab8347acb03d8216f633c3, disabling compactions & flushes 2023-07-11 20:12:45,006 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. after waiting 0 ms 2023-07-11 20:12:45,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,007 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,007 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a2b8f46affab8347acb03d8216f633c3: 2023-07-11 20:12:45,012 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:12:45,029 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689106365015"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106365015"}]},"ts":"1689106365015"} 2023-07-11 20:12:45,060 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 20:12:45,062 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:12:45,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106365062"}]},"ts":"1689106365062"} 2023-07-11 20:12:45,071 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-11 20:12:45,076 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:45,078 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:45,078 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:45,078 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:45,078 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:45,080 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a2b8f46affab8347acb03d8216f633c3, ASSIGN}] 2023-07-11 20:12:45,083 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a2b8f46affab8347acb03d8216f633c3, ASSIGN 2023-07-11 20:12:45,085 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a2b8f46affab8347acb03d8216f633c3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46707,1689106362013; forceNewPlan=false, retain=false 2023-07-11 20:12:45,238 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:12:45,239 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a2b8f46affab8347acb03d8216f633c3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:45,240 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689106365239"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106365239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106365239"}]},"ts":"1689106365239"} 2023-07-11 20:12:45,245 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a2b8f46affab8347acb03d8216f633c3, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:12:45,407 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2b8f46affab8347acb03d8216f633c3, NAME => 'hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:45,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. service=AccessControlService 2023-07-11 20:12:45,409 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:45,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:45,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,413 INFO [StoreOpener-a2b8f46affab8347acb03d8216f633c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,415 DEBUG [StoreOpener-a2b8f46affab8347acb03d8216f633c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/info 2023-07-11 20:12:45,415 DEBUG [StoreOpener-a2b8f46affab8347acb03d8216f633c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/info 2023-07-11 20:12:45,415 INFO [StoreOpener-a2b8f46affab8347acb03d8216f633c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2b8f46affab8347acb03d8216f633c3 columnFamilyName info 2023-07-11 20:12:45,416 INFO [StoreOpener-a2b8f46affab8347acb03d8216f633c3-1] regionserver.HStore(310): Store=a2b8f46affab8347acb03d8216f633c3/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:45,418 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,419 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:12:45,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:45,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2b8f46affab8347acb03d8216f633c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66611811, jitterRate=-0.007406666874885559}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:45,428 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2b8f46affab8347acb03d8216f633c3: 2023-07-11 20:12:45,432 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3., pid=6, masterSystemTime=1689106365400 2023-07-11 20:12:45,436 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,436 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:12:45,438 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a2b8f46affab8347acb03d8216f633c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:45,438 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689106365437"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106365437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106365437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106365437"}]},"ts":"1689106365437"} 2023-07-11 20:12:45,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-11 20:12:45,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a2b8f46affab8347acb03d8216f633c3, server=jenkins-hbase4.apache.org,46707,1689106362013 in 197 msec 2023-07-11 20:12:45,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-11 20:12:45,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a2b8f46affab8347acb03d8216f633c3, ASSIGN in 366 msec 2023-07-11 20:12:45,460 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:12:45,461 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106365461"}]},"ts":"1689106365461"} 2023-07-11 20:12:45,464 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-11 20:12:45,468 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:12:45,472 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 628 msec 2023-07-11 20:12:45,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-11 20:12:45,562 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:12:45,562 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:45,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-11 20:12:45,621 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:12:45,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 37 msec 2023-07-11 20:12:45,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-11 20:12:45,653 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-11 20:12:45,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-11 20:12:45,667 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-11 20:12:45,670 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-11 20:12:45,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.500sec 2023-07-11 20:12:45,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-11 20:12:45,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-11 20:12:45,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-11 20:12:45,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36627,1689106360268-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-11 20:12:45,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36627,1689106360268-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-11 20:12:45,703 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-11 20:12:45,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-11 20:12:45,708 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:12:45,710 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:12:45,713 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:45,713 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-11 20:12:45,714 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506 empty. 2023-07-11 20:12:45,716 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:45,716 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-11 20:12:45,722 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:45,748 DEBUG [Listener at localhost/39111] zookeeper.ReadOnlyZKClient(139): Connect 0x0789e732 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:45,756 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:45,759 DEBUG [Listener at localhost/39111] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cd4fb6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:45,759 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2bf19f7bc882b70da83d97bf0eebb506, NAME => 'hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:12:45,784 DEBUG [hconnection-0x422c7ffb-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:45,790 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:45,791 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 2bf19f7bc882b70da83d97bf0eebb506, disabling compactions & flushes 2023-07-11 20:12:45,791 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:45,791 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:45,791 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. after waiting 0 ms 2023-07-11 20:12:45,791 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:45,791 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:45,792 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 2bf19f7bc882b70da83d97bf0eebb506: 2023-07-11 20:12:45,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:12:45,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689106365798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106365798"}]},"ts":"1689106365798"} 2023-07-11 20:12:45,801 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:45,802 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-11 20:12:45,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:12:45,803 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106365803"}]},"ts":"1689106365803"} 2023-07-11 20:12:45,804 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:12:45,804 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-11 20:12:45,804 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/test.cache.data in system properties and HBase conf 2023-07-11 20:12:45,804 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop.tmp.dir in system properties and HBase conf 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop.log.dir in system properties and HBase conf 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-11 20:12:45,805 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/nfs.dump.dir in system properties and HBase conf 2023-07-11 20:12:45,806 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir in system properties and HBase conf 2023-07-11 20:12:45,807 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-11 20:12:45,807 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-11 20:12:45,807 INFO [Listener at localhost/39111] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-11 20:12:45,810 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:45,811 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:45,812 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:45,812 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:45,812 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:45,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2bf19f7bc882b70da83d97bf0eebb506, ASSIGN}] 2023-07-11 20:12:45,815 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=2bf19f7bc882b70da83d97bf0eebb506, ASSIGN 2023-07-11 20:12:45,816 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=2bf19f7bc882b70da83d97bf0eebb506, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:12:45,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:45,966 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:12:45,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2bf19f7bc882b70da83d97bf0eebb506, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:45,968 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689106365967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106365967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106365967"}]},"ts":"1689106365967"} 2023-07-11 20:12:45,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2bf19f7bc882b70da83d97bf0eebb506, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:12:46,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:46,142 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:46,143 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:12:46,147 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:12:46,156 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:46,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2bf19f7bc882b70da83d97bf0eebb506, NAME => 'hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:12:46,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. service=AccessControlService 2023-07-11 20:12:46,157 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:46,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:46,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,163 INFO [StoreOpener-2bf19f7bc882b70da83d97bf0eebb506-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,166 DEBUG [StoreOpener-2bf19f7bc882b70da83d97bf0eebb506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/l 2023-07-11 20:12:46,167 DEBUG [StoreOpener-2bf19f7bc882b70da83d97bf0eebb506-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/l 2023-07-11 20:12:46,167 INFO [StoreOpener-2bf19f7bc882b70da83d97bf0eebb506-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2bf19f7bc882b70da83d97bf0eebb506 columnFamilyName l 2023-07-11 20:12:46,168 INFO [StoreOpener-2bf19f7bc882b70da83d97bf0eebb506-1] regionserver.HStore(310): Store=2bf19f7bc882b70da83d97bf0eebb506/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:46,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,173 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:12:46,193 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:46,194 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2bf19f7bc882b70da83d97bf0eebb506; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69909588, jitterRate=0.04173403978347778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:46,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2bf19f7bc882b70da83d97bf0eebb506: 2023-07-11 20:12:46,196 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506., pid=11, masterSystemTime=1689106366142 2023-07-11 20:12:46,203 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2bf19f7bc882b70da83d97bf0eebb506, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:46,204 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689106366203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106366203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106366203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106366203"}]},"ts":"1689106366203"} 2023-07-11 20:12:46,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:46,206 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:12:46,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-11 20:12:46,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2bf19f7bc882b70da83d97bf0eebb506, server=jenkins-hbase4.apache.org,43979,1689106362092 in 235 msec 2023-07-11 20:12:46,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-11 20:12:46,218 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=2bf19f7bc882b70da83d97bf0eebb506, ASSIGN in 401 msec 2023-07-11 20:12:46,220 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:12:46,220 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106366220"}]},"ts":"1689106366220"} 2023-07-11 20:12:46,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-11 20:12:46,227 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:12:46,230 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 523 msec 2023-07-11 20:12:46,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-11 20:12:46,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-11 20:12:46,344 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-11 20:12:47,121 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:47,446 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:47,454 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34585_jobhistory____sdir16/webapp 2023-07-11 20:12:47,622 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-11 20:12:47,622 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:47,623 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:47,625 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:47,693 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:47,972 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:48,338 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-11 20:12:48,390 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34585 2023-07-11 20:12:48,625 WARN [Listener at jenkins-hbase4.apache.org/37901] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:49,087 WARN [Listener at jenkins-hbase4.apache.org/37901] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 20:12:49,088 INFO [Listener at jenkins-hbase4.apache.org/37901] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:49,100 INFO [Listener at jenkins-hbase4.apache.org/37901] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37917_cluster____dmfdl5/webapp 2023-07-11 20:12:49,197 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:49,197 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-11 20:12:49,198 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:49,198 INFO [Listener at jenkins-hbase4.apache.org/37901] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:49,211 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:49,496 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:49,778 INFO [Listener at jenkins-hbase4.apache.org/37901] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:49,796 INFO [Listener at jenkins-hbase4.apache.org/37901] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37917 2023-07-11 20:12:50,273 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:12:50,329 WARN [Listener at jenkins-hbase4.apache.org/33707] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:50,365 WARN [Listener at jenkins-hbase4.apache.org/33707] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 20:12:50,370 INFO [Listener at jenkins-hbase4.apache.org/33707] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:50,379 INFO [Listener at jenkins-hbase4.apache.org/33707] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36693_node____.jmv705/webapp 2023-07-11 20:12:50,455 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-11 20:12:50,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-11 20:12:50,457 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-11 20:12:50,458 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:12:50,459 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-11 20:12:50,459 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:12:50,459 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-11 20:12:50,460 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 20:12:50,460 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-11 20:12:50,460 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:12:50,460 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-11 20:12:50,460 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 20:12:50,460 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-11 20:12:50,461 INFO [Listener at jenkins-hbase4.apache.org/33707] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 20:12:50,461 INFO [Listener at jenkins-hbase4.apache.org/33707] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:50,462 INFO [Listener at jenkins-hbase4.apache.org/33707] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:50,462 INFO [Listener at jenkins-hbase4.apache.org/33707] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:50,475 INFO [Listener at jenkins-hbase4.apache.org/33707] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,504 INFO [Listener at jenkins-hbase4.apache.org/33707] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,621 INFO [Listener at jenkins-hbase4.apache.org/33707] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,634 INFO [Listener at jenkins-hbase4.apache.org/33707] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36693 2023-07-11 20:12:50,856 WARN [Listener at jenkins-hbase4.apache.org/34985] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-11 20:12:50,866 WARN [Listener at jenkins-hbase4.apache.org/34985] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-11 20:12:50,866 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): jetty-6.1.26 2023-07-11 20:12:50,874 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43065_node____qcpb9q/webapp 2023-07-11 20:12:50,936 INFO [Listener at jenkins-hbase4.apache.org/34985] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-11 20:12:50,936 INFO [Listener at jenkins-hbase4.apache.org/34985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-11 20:12:50,936 INFO [Listener at jenkins-hbase4.apache.org/34985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-11 20:12:50,936 INFO [Listener at jenkins-hbase4.apache.org/34985] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-11 20:12:50,944 INFO [Listener at jenkins-hbase4.apache.org/34985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:50,964 INFO [Listener at jenkins-hbase4.apache.org/34985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:51,068 INFO [Listener at jenkins-hbase4.apache.org/34985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-11 20:12:51,082 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43065 2023-07-11 20:12:51,126 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-11 20:12:51,128 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:51,209 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=174, AvailableMemoryMB=3686 2023-07-11 20:12:51,209 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-11 20:12:51,228 DEBUG [Listener at jenkins-hbase4.apache.org/34985] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-11 20:12:51,236 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-11 20:12:51,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 20:12:51,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:12:51,251 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:12:51,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-11 20:12:51,254 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:12:51,258 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,259 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 empty. 2023-07-11 20:12:51,270 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,270 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,272 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 empty. 2023-07-11 20:12:51,273 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,274 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 20:12:51,321 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-11 20:12:51,324 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3c4028708b36e10d941e1e3271d20b22, NAME => 'testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:12:51,325 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5e7b8532757ba03b644d04aed46d000, NAME => 'testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:12:51,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,374 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,375 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing b5e7b8532757ba03b644d04aed46d000, disabling compactions & flushes 2023-07-11 20:12:51,375 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,375 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,375 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. after waiting 0 ms 2023-07-11 20:12:51,375 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,375 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,375 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for b5e7b8532757ba03b644d04aed46d000: 2023-07-11 20:12:51,378 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,379 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 3c4028708b36e10d941e1e3271d20b22, disabling compactions & flushes 2023-07-11 20:12:51,379 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,379 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,379 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. after waiting 0 ms 2023-07-11 20:12:51,379 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,379 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,379 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 3c4028708b36e10d941e1e3271d20b22: 2023-07-11 20:12:51,385 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:12:51,387 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106371386"}]},"ts":"1689106371386"} 2023-07-11 20:12:51,387 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106371386"}]},"ts":"1689106371386"} 2023-07-11 20:12:51,444 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:12:51,445 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:12:51,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106371446"}]},"ts":"1689106371446"} 2023-07-11 20:12:51,448 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-11 20:12:51,455 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:12:51,457 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:12:51,457 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:12:51,457 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:12:51,458 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:12:51,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, ASSIGN}] 2023-07-11 20:12:51,461 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, ASSIGN 2023-07-11 20:12:51,461 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, ASSIGN 2023-07-11 20:12:51,463 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46707,1689106362013; forceNewPlan=false, retain=false 2023-07-11 20:12:51,463 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:12:51,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,613 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:12:51,616 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3c4028708b36e10d941e1e3271d20b22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:51,616 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b5e7b8532757ba03b644d04aed46d000, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:51,616 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106371616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106371616"}]},"ts":"1689106371616"} 2023-07-11 20:12:51,616 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106371616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106371616"}]},"ts":"1689106371616"} 2023-07-11 20:12:51,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 3c4028708b36e10d941e1e3271d20b22, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:12:51,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure b5e7b8532757ba03b644d04aed46d000, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:12:51,778 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c4028708b36e10d941e1e3271d20b22, NAME => 'testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:12:51,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. service=AccessControlService 2023-07-11 20:12:51,779 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:51,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5e7b8532757ba03b644d04aed46d000, NAME => 'testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:12:51,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. service=AccessControlService 2023-07-11 20:12:51,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:12:51,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:12:51,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,786 INFO [StoreOpener-3c4028708b36e10d941e1e3271d20b22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,786 INFO [StoreOpener-b5e7b8532757ba03b644d04aed46d000-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,789 DEBUG [StoreOpener-3c4028708b36e10d941e1e3271d20b22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf 2023-07-11 20:12:51,789 DEBUG [StoreOpener-3c4028708b36e10d941e1e3271d20b22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf 2023-07-11 20:12:51,790 DEBUG [StoreOpener-b5e7b8532757ba03b644d04aed46d000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf 2023-07-11 20:12:51,791 DEBUG [StoreOpener-b5e7b8532757ba03b644d04aed46d000-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf 2023-07-11 20:12:51,794 INFO [StoreOpener-b5e7b8532757ba03b644d04aed46d000-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5e7b8532757ba03b644d04aed46d000 columnFamilyName cf 2023-07-11 20:12:51,794 INFO [StoreOpener-3c4028708b36e10d941e1e3271d20b22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c4028708b36e10d941e1e3271d20b22 columnFamilyName cf 2023-07-11 20:12:51,799 INFO [StoreOpener-3c4028708b36e10d941e1e3271d20b22-1] regionserver.HStore(310): Store=3c4028708b36e10d941e1e3271d20b22/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:51,800 INFO [StoreOpener-b5e7b8532757ba03b644d04aed46d000-1] regionserver.HStore(310): Store=b5e7b8532757ba03b644d04aed46d000/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:12:51,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:12:51,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:12:51,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:51,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3c4028708b36e10d941e1e3271d20b22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60202463, jitterRate=-0.10291339457035065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:51,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3c4028708b36e10d941e1e3271d20b22: 2023-07-11 20:12:51,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22., pid=15, masterSystemTime=1689106371772 2023-07-11 20:12:51,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:51,827 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3c4028708b36e10d941e1e3271d20b22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:51,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:12:51,827 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371827"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106371827"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106371827"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106371827"}]},"ts":"1689106371827"} 2023-07-11 20:12:51,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5e7b8532757ba03b644d04aed46d000; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69225209, jitterRate=0.03153599798679352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:12:51,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5e7b8532757ba03b644d04aed46d000: 2023-07-11 20:12:51,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000., pid=16, masterSystemTime=1689106371773 2023-07-11 20:12:51,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:51,834 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b5e7b8532757ba03b644d04aed46d000, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:51,838 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106371834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106371834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106371834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106371834"}]},"ts":"1689106371834"} 2023-07-11 20:12:51,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-11 20:12:51,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 3c4028708b36e10d941e1e3271d20b22, server=jenkins-hbase4.apache.org,46707,1689106362013 in 212 msec 2023-07-11 20:12:51,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, ASSIGN in 383 msec 2023-07-11 20:12:51,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-11 20:12:51,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure b5e7b8532757ba03b644d04aed46d000, server=jenkins-hbase4.apache.org,43979,1689106362092 in 221 msec 2023-07-11 20:12:51,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-11 20:12:51,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, ASSIGN in 393 msec 2023-07-11 20:12:51,856 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:12:51,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106371856"}]},"ts":"1689106371856"} 2023-07-11 20:12:51,858 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-11 20:12:51,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:12:51,866 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-11 20:12:51,875 DEBUG [PEWorker-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:51,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:51,876 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:51,880 DEBUG [hconnection-0x56bffd36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:51,883 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-11 20:12:51,891 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 20:12:51,923 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,923 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,924 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:12:51,923 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,923 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-11 20:12:51,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-11 20:12:51,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 688 msec 2023-07-11 20:12:52,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-11 20:12:52,378 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-11 20:12:52,384 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 20:12:52,385 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:52,387 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:52,413 DEBUG [hconnection-0x422c7ffb-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,419 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:52,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106372436 (current time:1689106372436). 2023-07-11 20:12:52,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:12:52,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x5afb3cee to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:52,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37e8217d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:52,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,452 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5afb3cee to 127.0.0.1:53621 2023-07-11 20:12:52,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:52,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x26b123ce to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:52,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d531905, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:52,570 DEBUG [hconnection-0x7990b5a5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,572 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:52,579 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:52,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26b123ce to 127.0.0.1:53621 2023-07-11 20:12:52,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:52,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 20:12:52,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:12:52,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:52,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:52,634 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:52,635 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689106972635 2023-07-11 20:12:52,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:52,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 20:12:52,644 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:52,644 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:12:52,644 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:12:52,645 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:52,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-11 20:12:52,653 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:52,658 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689106972658 2023-07-11 20:12:52,693 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,694 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-11 20:12:52,694 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,695 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 20:12:52,695 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 20:12:52,696 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,696 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,700 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,700 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,700 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:52,700 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:52,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:52,701 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,701 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,701 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,701 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:12:52,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,702 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 20:12:52,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 20:12:52,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,703 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:52,703 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-11 20:12:52,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,708 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:52,708 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:52,708 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,715 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:52,715 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,715 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:52,715 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,715 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:52,716 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:52,716 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:52,716 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:52,716 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:52,717 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:52,716 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:52,718 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:52,718 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:52,718 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:52,727 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,727 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,728 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,729 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:52,730 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,730 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,731 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:52,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@206b2b8c[Count = 1] remaining members to acquire global barrier 2023-07-11 20:12:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:52,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@206b2b8c[Count = 0] remaining members to acquire global barrier 2023-07-11 20:12:52,736 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 20:12:52,736 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,738 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,740 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,740 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,740 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,741 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,741 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:52,741 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:52,741 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:52,741 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,741 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:12:52,742 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:52,742 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:52,742 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:52,743 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. started... 2023-07-11 20:12:52,745 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:52,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,745 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:52,745 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:52,745 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:12:52,747 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c4028708b36e10d941e1e3271d20b22: 2023-07-11 20:12:52,748 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:52,754 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:52,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:52,756 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:52,756 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:12:52,759 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:52,760 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:52,760 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:52,764 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:52,764 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. started... 2023-07-11 20:12:52,764 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5e7b8532757ba03b644d04aed46d000: 2023-07-11 20:12:52,764 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,771 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:52,773 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:52,776 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:12:52,776 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:12:52,824 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. completed. 2023-07-11 20:12:52,824 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:52,824 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,827 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:52,827 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:12:52,832 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:52,834 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:52,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:52,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:52,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:12:52,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 20:12:52,956 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:52,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:52,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:52,958 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:12:53,235 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. completed. 2023-07-11 20:12:53,235 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:53,236 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:53,236 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:53,236 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,236 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:53,236 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:12:53,238 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,238 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:53,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,238 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:53,238 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:53,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46707,1689106362013': 2023-07-11 20:12:53,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 20:12:53,247 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-11 20:12:53,248 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:12:53,248 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:12:53,248 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,248 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,253 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,255 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,256 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,257 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,258 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:53,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,259 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:53,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:53,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,260 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:12:53,260 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,265 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,291 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,291 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,291 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,291 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:53,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,294 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,294 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:53,294 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,295 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-11 20:12:53,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:12:53,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 20:12:53,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:53,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:53,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,434 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 20:12:53,434 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,434 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-11 20:12:53,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689106372636Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689106373331 (+695 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689106373331Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689106373331Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689106373347 (+16 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689106373383 (+36 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689106373434 (+51 ms) 2023-07-11 20:12:53,437 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:53,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 799 msec 2023-07-11 20:12:53,760 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:53,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:53,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:12:53,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43979] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:12:53,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:12:53,782 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-11 20:12:53,783 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:53,783 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:12:53,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:53,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106373799 (current time:1689106373799). 2023-07-11 20:12:53,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:12:53,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x39b0b7d9 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:53,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@204c792, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:53,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,811 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39b0b7d9 to 127.0.0.1:53621 2023-07-11 20:12:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x2ac7a4db to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:12:53,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1675c025, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:12:53,920 DEBUG [hconnection-0x32e9ad2e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,924 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:12:53,933 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:12:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ac7a4db to 127.0.0.1:53621 2023-07-11 20:12:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:12:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-11 20:12:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:12:53,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:53,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:53,943 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:53,945 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689106973945 2023-07-11 20:12:53,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-11 20:12:53,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-11 20:12:53,947 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:12:53,947 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:12:53,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:53,949 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-11 20:12:53,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-11 20:12:53,952 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:53,953 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689106973953 2023-07-11 20:12:53,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-11 20:12:53,978 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-11 20:12:53,978 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,979 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-11 20:12:53,979 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-11 20:12:53,980 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,980 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,982 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,982 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,982 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,982 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:53,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:53,986 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,986 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,986 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,986 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:12:53,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:53,987 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-11 20:12:53,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,988 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-11 20:12:53,988 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:53,988 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:53,988 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,988 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-11 20:12:53,989 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:53,989 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:53,988 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,989 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:53,990 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:53,990 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:53,989 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:12:53,990 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:53,991 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-11 20:12:53,992 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-11 20:12:53,992 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-11 20:12:53,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,994 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:53,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:53,997 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:53,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:53,997 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:53,998 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:12:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:53,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:53,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:53,999 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:54,000 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e6df8f2[Count = 1] remaining members to acquire global barrier 2023-07-11 20:12:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:54,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:54,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:54,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-11 20:12:54,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e6df8f2[Count = 0] remaining members to acquire global barrier 2023-07-11 20:12:54,002 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-11 20:12:54,002 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:54,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:54,007 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:12:54,008 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:54,007 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:54,008 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. started... 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:54,007 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:12:54,008 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. started... 2023-07-11 20:12:54,008 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:12:54,008 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:12:54,008 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5e7b8532757ba03b644d04aed46d000 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-11 20:12:54,008 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3c4028708b36e10d941e1e3271d20b22 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-11 20:12:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:54,011 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:54,048 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:54,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:54,050 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:12:54,141 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307112747060dc54e4d65a081d8f310ba9c64 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307112747060dc54e4d65a081d8f310ba9c64 2023-07-11 20:12:54,164 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/.tmp/cf/66295006eac642cc9ab00f7f8cd948b4 2023-07-11 20:12:54,174 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/.tmp/cf/66295006eac642cc9ab00f7f8cd948b4 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf/66295006eac642cc9ab00f7f8cd948b4 2023-07-11 20:12:54,182 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf/66295006eac642cc9ab00f7f8cd948b4, entries=45, sequenceid=6, filesize=12.5 K 2023-07-11 20:12:54,184 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 3c4028708b36e10d941e1e3271d20b22 in 176ms, sequenceid=6, compaction requested=false 2023-07-11 20:12:54,184 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-11 20:12:54,185 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c4028708b36e10d941e1e3271d20b22: 2023-07-11 20:12:54,185 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:54,185 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:54,186 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf/66295006eac642cc9ab00f7f8cd948b4] hfiles 2023-07-11 20:12:54,186 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf/66295006eac642cc9ab00f7f8cd948b4 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:54,204 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. completed. 2023-07-11 20:12:54,204 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:12:54,204 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:54,204 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:54,204 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,205 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:54,205 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:12:54,206 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:54,206 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,206 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:54,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:54,207 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:54,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,46707,1689106362013': 2023-07-11 20:12:54,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-11 20:12:54,250 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:54,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:54,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:54,251 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:12:54,514 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711ed8277a5e4724897b3214e3149c1ac23 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230711ed8277a5e4724897b3214e3149c1ac23 2023-07-11 20:12:54,538 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/.tmp/cf/487529b11cb941d9944064be44e387f0 2023-07-11 20:12:54,552 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:54,555 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/.tmp/cf/487529b11cb941d9944064be44e387f0 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf/487529b11cb941d9944064be44e387f0 2023-07-11 20:12:54,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:54,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:12:54,555 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:12:54,565 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf/487529b11cb941d9944064be44e387f0, entries=5, sequenceid=6, filesize=5.7 K 2023-07-11 20:12:54,568 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for b5e7b8532757ba03b644d04aed46d000 in 560ms, sequenceid=6, compaction requested=false 2023-07-11 20:12:54,569 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5e7b8532757ba03b644d04aed46d000: 2023-07-11 20:12:54,570 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:54,570 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:12:54,570 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf/487529b11cb941d9944064be44e387f0] hfiles 2023-07-11 20:12:54,570 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf/487529b11cb941d9944064be44e387f0 for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:54,602 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. completed. 2023-07-11 20:12:54,602 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:12:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:12:54,602 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:12:54,603 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,603 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-11 20:12:54,603 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:12:54,606 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:54,607 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-11 20:12:54,607 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:54,607 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-11 20:12:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:12:54,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-11 20:12:54,615 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-11 20:12:54,616 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:12:54,616 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:12:54,616 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-11 20:12:54,616 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:12:54,619 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,619 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,619 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:54,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:12:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:12:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,619 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,619 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,620 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:54,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:54,620 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:54,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:54,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:54,622 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:12:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,623 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,623 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:12:54,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,628 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,629 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:12:54,630 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-11 20:12:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:54,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:54,646 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:12:54,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:54,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:54,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:12:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:12:54,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:54,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:54,646 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,649 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-11 20:12:54,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:12:54,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:12:54,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:12:54,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307112747060dc54e4d65a081d8f310ba9c64, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230711ed8277a5e4724897b3214e3149c1ac23] mob files 2023-07-11 20:12:54,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307112747060dc54e4d65a081d8f310ba9c64 2023-07-11 20:12:54,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230711ed8277a5e4724897b3214e3149c1ac23 2023-07-11 20:12:54,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-11 20:12:54,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-11 20:12:54,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,848 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-11 20:12:54,849 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689106373945Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689106374678 (+733 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689106374678Loading Region manifests for snaptb0-testExportWithTargetName at 1689106374678Writing data manifest for snaptb0-testExportWithTargetName at 1689106374686 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689106374723 (+37 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689106374846 (+123 ms) 2023-07-11 20:12:54,852 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-11 20:12:54,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 906 msec 2023-07-11 20:12:55,057 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:12:55,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-11 20:12:55,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:12:55,061 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061 2023-07-11 20:12:55,062 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:12:55,143 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:12:55,143 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2046935622_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 20:12:55,143 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-11 20:12:55,183 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-11 20:12:55,297 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,298 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,299 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,299 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,300 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,300 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,301 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,395 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-7129984067379767991.jar 2023-07-11 20:12:55,396 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,396 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,397 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,397 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,398 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,399 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:12:55,399 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:12:55,400 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:12:55,400 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:12:55,401 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:12:55,401 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:12:55,402 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:12:55,402 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:12:55,403 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:12:55,403 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:12:55,404 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:12:55,408 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:55,409 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:55,409 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:12:55,410 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:55,410 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:12:55,411 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:12:55,412 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:12:56,449 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:12:56,454 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-11 20:12:56,462 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-11 20:12:56,982 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:12:56,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:12:57,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0001_000001 (auth:SIMPLE) 2023-07-11 20:12:57,312 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:13:02,511 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:04,765 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:08,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:10,422 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:10,424 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:10,447 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-11 20:13:10,447 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:10,448 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:10,449 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-11 20:13:10,449 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-11 20:13:10,450 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-11 20:13:10,450 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061/.hbase-snapshot/testExportWithTargetName 2023-07-11 20:13:10,451 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-11 20:13:10,451 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106375061/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-11 20:13:10,464 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-11 20:13:10,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-11 20:13:10,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 20:13:10,488 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106390488"}]},"ts":"1689106390488"} 2023-07-11 20:13:10,490 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-11 20:13:10,493 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-11 20:13:10,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, UNASSIGN}] 2023-07-11 20:13:10,498 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, UNASSIGN 2023-07-11 20:13:10,499 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, UNASSIGN 2023-07-11 20:13:10,500 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3c4028708b36e10d941e1e3271d20b22, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:10,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106390499"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106390499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106390499"}]},"ts":"1689106390499"} 2023-07-11 20:13:10,500 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b5e7b8532757ba03b644d04aed46d000, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:10,500 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106390500"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106390500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106390500"}]},"ts":"1689106390500"} 2023-07-11 20:13:10,503 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 3c4028708b36e10d941e1e3271d20b22, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:13:10,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure b5e7b8532757ba03b644d04aed46d000, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:13:10,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 20:13:10,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:13:10,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3c4028708b36e10d941e1e3271d20b22, disabling compactions & flushes 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5e7b8532757ba03b644d04aed46d000, disabling compactions & flushes 2023-07-11 20:13:10,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:13:10,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. after waiting 0 ms 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. after waiting 0 ms 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:13:10,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:13:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:10,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:10,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:10,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:10,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22. 2023-07-11 20:13:10,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3c4028708b36e10d941e1e3271d20b22: 2023-07-11 20:13:10,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000. 2023-07-11 20:13:10,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5e7b8532757ba03b644d04aed46d000: 2023-07-11 20:13:10,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:13:10,701 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=b5e7b8532757ba03b644d04aed46d000, regionState=CLOSED 2023-07-11 20:13:10,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106390701"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106390701"}]},"ts":"1689106390701"} 2023-07-11 20:13:10,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:13:10,704 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3c4028708b36e10d941e1e3271d20b22, regionState=CLOSED 2023-07-11 20:13:10,705 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689106390704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106390704"}]},"ts":"1689106390704"} 2023-07-11 20:13:10,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-11 20:13:10,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-11 20:13:10,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 3c4028708b36e10d941e1e3271d20b22, server=jenkins-hbase4.apache.org,46707,1689106362013 in 204 msec 2023-07-11 20:13:10,717 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure b5e7b8532757ba03b644d04aed46d000, server=jenkins-hbase4.apache.org,43979,1689106362092 in 200 msec 2023-07-11 20:13:10,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c4028708b36e10d941e1e3271d20b22, UNASSIGN in 222 msec 2023-07-11 20:13:10,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-11 20:13:10,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=b5e7b8532757ba03b644d04aed46d000, UNASSIGN in 222 msec 2023-07-11 20:13:10,721 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106390720"}]},"ts":"1689106390720"} 2023-07-11 20:13:10,722 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-11 20:13:10,724 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-11 20:13:10,727 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 252 msec 2023-07-11 20:13:10,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-11 20:13:10,792 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-11 20:13:10,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-11 20:13:10,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,806 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-11 20:13:10,808 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,811 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-11 20:13:10,814 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:10,814 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:10,814 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:10,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:13:10,814 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-11 20:13:10,814 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:13:10,817 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:10,817 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:10,817 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:10,818 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:10,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:10,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:10,818 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:10,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:10,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-11 20:13:10,818 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:10,818 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:10,818 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-11 20:13:10,819 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/recovered.edits] 2023-07-11 20:13:10,819 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/recovered.edits] 2023-07-11 20:13:10,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 20:13:10,828 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf/66295006eac642cc9ab00f7f8cd948b4 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/cf/66295006eac642cc9ab00f7f8cd948b4 2023-07-11 20:13:10,828 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf/487529b11cb941d9944064be44e387f0 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/cf/487529b11cb941d9944064be44e387f0 2023-07-11 20:13:10,835 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22/recovered.edits/9.seqid 2023-07-11 20:13:10,835 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000/recovered.edits/9.seqid 2023-07-11 20:13:10,835 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/3c4028708b36e10d941e1e3271d20b22 2023-07-11 20:13:10,836 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportWithTargetName/b5e7b8532757ba03b644d04aed46d000 2023-07-11 20:13:10,836 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-11 20:13:10,836 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-11 20:13:10,837 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-11 20:13:10,844 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307112747060dc54e4d65a081d8f310ba9c64 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307112747060dc54e4d65a081d8f310ba9c64 2023-07-11 20:13:10,846 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230711ed8277a5e4724897b3214e3149c1ac23 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230711ed8277a5e4724897b3214e3149c1ac23 2023-07-11 20:13:10,846 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-11 20:13:10,851 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,885 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-11 20:13:10,891 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-11 20:13:10,893 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,893 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-11 20:13:10,894 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106390893"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:10,894 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106390893"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:10,898 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:13:10,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b5e7b8532757ba03b644d04aed46d000, NAME => 'testtb-testExportWithTargetName,,1689106371243.b5e7b8532757ba03b644d04aed46d000.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3c4028708b36e10d941e1e3271d20b22, NAME => 'testtb-testExportWithTargetName,1,1689106371243.3c4028708b36e10d941e1e3271d20b22.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:13:10,898 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-11 20:13:10,898 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106390898"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:10,906 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-11 20:13:10,909 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-11 20:13:10,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 111 msec 2023-07-11 20:13:10,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-11 20:13:10,926 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-11 20:13:10,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-11 20:13:10,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-11 20:13:10,954 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-11 20:13:10,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-11 20:13:10,989 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=752 (was 706) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:47510 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:43475 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:42743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1002486663_1 at /127.0.0.1:47842 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:33707 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:56550 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 246) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=1995 (was 3686) 2023-07-11 20:13:10,989 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-11 20:13:11,013 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=752, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=180, AvailableMemoryMB=1994 2023-07-11 20:13:11,013 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=752 is superior to 500 2023-07-11 20:13:11,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 20:13:11,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:11,020 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:13:11,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-11 20:13:11,023 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:13:11,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:11,026 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,026 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,026 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 empty. 2023-07-11 20:13:11,026 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a empty. 2023-07-11 20:13:11,027 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,027 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,027 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 20:13:11,040 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 20:13:11,042 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => f4a0a09ad9fc556b0e862431c024dfa2, NAME => 'testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:13:11,043 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4a7ef374f7540a1d0335d6ce238fb54a, NAME => 'testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:13:11,065 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:11,066 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing f4a0a09ad9fc556b0e862431c024dfa2, disabling compactions & flushes 2023-07-11 20:13:11,066 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,066 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,066 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. after waiting 0 ms 2023-07-11 20:13:11,066 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,067 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,067 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for f4a0a09ad9fc556b0e862431c024dfa2: 2023-07-11 20:13:11,069 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:11,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4a7ef374f7540a1d0335d6ce238fb54a, disabling compactions & flushes 2023-07-11 20:13:11,070 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. after waiting 0 ms 2023-07-11 20:13:11,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,070 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,070 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4a7ef374f7540a1d0335d6ce238fb54a: 2023-07-11 20:13:11,074 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:13:11,075 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106391074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106391074"}]},"ts":"1689106391074"} 2023-07-11 20:13:11,075 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106391074"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106391074"}]},"ts":"1689106391074"} 2023-07-11 20:13:11,077 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:13:11,078 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:13:11,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106391078"}]},"ts":"1689106391078"} 2023-07-11 20:13:11,080 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 20:13:11,084 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:13:11,086 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:13:11,086 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:13:11,086 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:13:11,086 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:13:11,086 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, ASSIGN}] 2023-07-11 20:13:11,090 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, ASSIGN 2023-07-11 20:13:11,090 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, ASSIGN 2023-07-11 20:13:11,091 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40513,1689106361915; forceNewPlan=false, retain=false 2023-07-11 20:13:11,091 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:13:11,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:11,241 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:13:11,245 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4a7ef374f7540a1d0335d6ce238fb54a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,245 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f4a0a09ad9fc556b0e862431c024dfa2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,245 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106391245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106391245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106391245"}]},"ts":"1689106391245"} 2023-07-11 20:13:11,245 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106391245"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106391245"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106391245"}]},"ts":"1689106391245"} 2023-07-11 20:13:11,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure f4a0a09ad9fc556b0e862431c024dfa2, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:13:11,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 4a7ef374f7540a1d0335d6ce238fb54a, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:13:11,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:11,406 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,407 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:13:11,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a7ef374f7540a1d0335d6ce238fb54a, NAME => 'testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:13:11,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. service=AccessControlService 2023-07-11 20:13:11,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:11,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:11,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,417 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:13:11,417 INFO [StoreOpener-4a7ef374f7540a1d0335d6ce238fb54a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,421 DEBUG [StoreOpener-4a7ef374f7540a1d0335d6ce238fb54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf 2023-07-11 20:13:11,421 DEBUG [StoreOpener-4a7ef374f7540a1d0335d6ce238fb54a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf 2023-07-11 20:13:11,422 INFO [StoreOpener-4a7ef374f7540a1d0335d6ce238fb54a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a7ef374f7540a1d0335d6ce238fb54a columnFamilyName cf 2023-07-11 20:13:11,425 INFO [StoreOpener-4a7ef374f7540a1d0335d6ce238fb54a-1] regionserver.HStore(310): Store=4a7ef374f7540a1d0335d6ce238fb54a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:11,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4a0a09ad9fc556b0e862431c024dfa2, NAME => 'testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. service=AccessControlService 2023-07-11 20:13:11,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,429 INFO [StoreOpener-f4a0a09ad9fc556b0e862431c024dfa2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:11,430 DEBUG [StoreOpener-f4a0a09ad9fc556b0e862431c024dfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf 2023-07-11 20:13:11,430 DEBUG [StoreOpener-f4a0a09ad9fc556b0e862431c024dfa2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf 2023-07-11 20:13:11,431 INFO [StoreOpener-f4a0a09ad9fc556b0e862431c024dfa2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4a0a09ad9fc556b0e862431c024dfa2 columnFamilyName cf 2023-07-11 20:13:11,432 INFO [StoreOpener-f4a0a09ad9fc556b0e862431c024dfa2-1] regionserver.HStore(310): Store=f4a0a09ad9fc556b0e862431c024dfa2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:11,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:11,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a7ef374f7540a1d0335d6ce238fb54a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61286631, jitterRate=-0.08675803244113922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:11,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a7ef374f7540a1d0335d6ce238fb54a: 2023-07-11 20:13:11,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a., pid=31, masterSystemTime=1689106391406 2023-07-11 20:13:11,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:11,442 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:11,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4a0a09ad9fc556b0e862431c024dfa2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64958355, jitterRate=-0.03204508125782013}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:11,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4a0a09ad9fc556b0e862431c024dfa2: 2023-07-11 20:13:11,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,443 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2., pid=30, masterSystemTime=1689106391406 2023-07-11 20:13:11,447 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4a7ef374f7540a1d0335d6ce238fb54a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,451 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106391447"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106391447"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106391447"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106391447"}]},"ts":"1689106391447"} 2023-07-11 20:13:11,456 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f4a0a09ad9fc556b0e862431c024dfa2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,456 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106391455"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106391455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106391455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106391455"}]},"ts":"1689106391455"} 2023-07-11 20:13:11,457 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-11 20:13:11,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 4a7ef374f7540a1d0335d6ce238fb54a, server=jenkins-hbase4.apache.org,43979,1689106362092 in 202 msec 2023-07-11 20:13:11,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, ASSIGN in 374 msec 2023-07-11 20:13:11,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-11 20:13:11,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure f4a0a09ad9fc556b0e862431c024dfa2, server=jenkins-hbase4.apache.org,40513,1689106361915 in 215 msec 2023-07-11 20:13:11,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-11 20:13:11,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, ASSIGN in 380 msec 2023-07-11 20:13:11,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:13:11,471 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106391470"}]},"ts":"1689106391470"} 2023-07-11 20:13:11,472 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 20:13:11,475 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:13:11,476 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-11 20:13:11,478 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:13:11,479 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:11,479 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:11,479 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:11,479 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:11,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:11,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:11,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:11,481 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:11,483 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 465 msec 2023-07-11 20:13:11,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-11 20:13:11,627 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-11 20:13:11,630 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 20:13:11,630 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,634 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:11,643 DEBUG [hconnection-0x422c7ffb-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:11,648 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:11,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:11,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106391653 (current time:1689106391653). 2023-07-11 20:13:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x63d95a7e to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:11,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fb70d1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:11,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:11,662 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:11,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63d95a7e to 127.0.0.1:53621 2023-07-11 20:13:11,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:11,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x6f1bd9f8 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:11,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@463864cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:11,670 DEBUG [hconnection-0x41e076c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:11,673 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:11,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:11,677 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:11,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f1bd9f8 to 127.0.0.1:53621 2023-07-11 20:13:11,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:11,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:13:11,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:11,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:11,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:11,683 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:11,684 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689106991684 2023-07-11 20:13:11,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:11,684 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 20:13:11,685 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:11,686 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:11,688 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:11,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-11 20:13:11,691 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:11,692 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689106991692 2023-07-11 20:13:11,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,719 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-11 20:13:11,719 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:11,720 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 20:13:11,720 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:13:11,721 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,721 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,722 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:11,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:11,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:11,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:11,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:11,723 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:11,723 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,723 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,723 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:11,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:11,724 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:11,726 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,727 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:11,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,727 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,727 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:11,727 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:11,728 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:11,727 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:11,729 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:11,729 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:11,729 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:11,729 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:11,730 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:11,731 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:11,731 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:11,731 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:11,732 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:11,732 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:11,734 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,734 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:11,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:11,739 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,739 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,739 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,739 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:11,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:11,739 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,739 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:11,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:11,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:11,742 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,743 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,743 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:11,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:11,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:11,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@866eb48[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:11,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:11,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:11,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:11,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:11,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:11,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:11,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@866eb48[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:11,747 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:13:11,747 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,748 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,748 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,749 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:11,749 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:11,749 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,749 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:11,749 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:11,749 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:11,749 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. started... 2023-07-11 20:13:11,749 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,749 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4a0a09ad9fc556b0e862431c024dfa2: 2023-07-11 20:13:11,749 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:11,750 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,750 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:11,750 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:11,750 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:11,750 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,750 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. started... 2023-07-11 20:13:11,752 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,752 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a7ef374f7540a1d0335d6ce238fb54a: 2023-07-11 20:13:11,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:11,752 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:13:11,754 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,754 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:11,754 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:11,754 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:11,786 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:11,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:11,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:11,787 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:11,822 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. completed. 2023-07-11 20:13:11,822 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:11,822 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:11,822 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:11,822 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,822 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:11,822 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:13:11,825 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:11,825 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,825 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:11,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:11,825 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:11,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:11,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:11,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:11,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:11,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:13:11,838 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:13:11,988 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:11,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:11,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:11,989 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:13:12,235 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. completed. 2023-07-11 20:13:12,235 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:12,235 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:12,236 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:13:12,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:12,239 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:12,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:12,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:13:12,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:13:12,246 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-11 20:13:12,246 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:12,246 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:12,246 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,246 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:12,248 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,248 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,248 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,248 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,249 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,248 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,249 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,250 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,250 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,250 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,253 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,253 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,254 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,258 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,259 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-11 20:13:12,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,258 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,260 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 20:13:12,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,289 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:12,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:12,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:12,291 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:13:12,295 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,318 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 20:13:12,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,318 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:12,318 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689106391684Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689106392270 (+586 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689106392270Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689106392270Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689106392276 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689106392288 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689106392318 (+30 ms) 2023-07-11 20:13:12,321 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:12,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 636 msec 2023-07-11 20:13:12,791 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:12,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:12,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:12,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:12,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43979] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:12,802 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-11 20:13:12,802 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:12,802 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:12,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:12,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106392814 (current time:1689106392814). 2023-07-11 20:13:12,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:12,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x3d1db599 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:12,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d85998f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:12,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:12,825 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:12,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d1db599 to 127.0.0.1:53621 2023-07-11 20:13:12,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:12,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x102ff6e3 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:12,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21e69875, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:12,836 DEBUG [hconnection-0x1d2ce4ee-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:12,837 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:12,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:12,843 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50008, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:12,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x102ff6e3 to 127.0.0.1:53621 2023-07-11 20:13:12,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:12,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:13:12,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:12,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:12,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:12,848 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:12,849 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689106992849 2023-07-11 20:13:12,849 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-11 20:13:12,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:13:12,850 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:12,850 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:12,852 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:13:12,852 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:12,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-11 20:13:12,854 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:12,855 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689106992855 2023-07-11 20:13:12,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-11 20:13:12,869 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-11 20:13:12,869 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:12,871 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-11 20:13:12,871 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:13:12,871 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,871 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,873 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,873 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,873 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,873 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,873 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,873 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,874 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,874 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,875 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 20:13:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:12,875 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:12,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:12,875 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:12,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:12,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:12,876 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:12,877 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-11 20:13:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-11 20:13:12,878 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-11 20:13:12,881 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,881 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,882 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,882 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:12,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@599d38de[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-11 20:13:12,887 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@599d38de[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:12,887 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:13:12,887 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,888 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,888 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,888 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,889 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:12,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,889 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:13:12,889 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. started... 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:12,889 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,889 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:12,889 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:12,890 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:12,890 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:12,890 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. started... 2023-07-11 20:13:12,889 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4a7ef374f7540a1d0335d6ce238fb54a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 20:13:12,890 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f4a0a09ad9fc556b0e862431c024dfa2 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 20:13:12,891 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:12,891 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:12,891 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:12,916 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711ba2f09f537bd4deeb2e9bab25f67f76b to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ba2f09f537bd4deeb2e9bab25f67f76b 2023-07-11 20:13:12,916 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307116f6bcc9e8c634481b32d8837dd22d237 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307116f6bcc9e8c634481b32d8837dd22d237 2023-07-11 20:13:12,925 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/.tmp/cf/b422425bff82437c96414f440cd06932 2023-07-11 20:13:12,925 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/.tmp/cf/04abcd4c2e0f4a06af065219452efa51 2023-07-11 20:13:12,933 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/.tmp/cf/04abcd4c2e0f4a06af065219452efa51 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf/04abcd4c2e0f4a06af065219452efa51 2023-07-11 20:13:12,933 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/.tmp/cf/b422425bff82437c96414f440cd06932 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf/b422425bff82437c96414f440cd06932 2023-07-11 20:13:12,940 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf/04abcd4c2e0f4a06af065219452efa51, entries=48, sequenceid=6, filesize=13.0 K 2023-07-11 20:13:12,940 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf/b422425bff82437c96414f440cd06932, entries=2, sequenceid=6, filesize=5.2 K 2023-07-11 20:13:12,941 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f4a0a09ad9fc556b0e862431c024dfa2 in 51ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:12,941 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4a7ef374f7540a1d0335d6ce238fb54a in 52ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:12,941 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-11 20:13:12,941 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-11 20:13:12,944 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4a0a09ad9fc556b0e862431c024dfa2: 2023-07-11 20:13:12,944 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a7ef374f7540a1d0335d6ce238fb54a: 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf/b422425bff82437c96414f440cd06932] hfiles 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf/04abcd4c2e0f4a06af065219452efa51] hfiles 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf/b422425bff82437c96414f440cd06932 for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:12,945 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf/04abcd4c2e0f4a06af065219452efa51 for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:12,950 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:12,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:12,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:12,952 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:12,966 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. completed. 2023-07-11 20:13:12,966 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:12,966 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:12,966 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:12,966 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,966 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:12,966 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:13:12,968 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. completed. 2023-07-11 20:13:12,968 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:12,968 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:12,968 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:12,968 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,968 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-11 20:13:12,968 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:13:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:12,974 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:12,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,974 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-11 20:13:12,976 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:12,976 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-11 20:13:12,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:13:12,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:13:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:13:12,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:13:12,984 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-11 20:13:12,984 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:12,984 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:12,984 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-11 20:13:12,984 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:12,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,986 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,987 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:12,987 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,988 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,990 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:12,990 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-11 20:13:12,991 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,993 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:12,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,994 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:12,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:12,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,994 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,994 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-11 20:13:12,996 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:12,996 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-11 20:13:12,996 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:12,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-11 20:13:12,996 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:12,996 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:12,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:13:12,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,996 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,996 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-11 20:13:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:12,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:12,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307116f6bcc9e8c634481b32d8837dd22d237, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ba2f09f537bd4deeb2e9bab25f67f76b] mob files 2023-07-11 20:13:12,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307116f6bcc9e8c634481b32d8837dd22d237 2023-07-11 20:13:12,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ba2f09f537bd4deeb2e9bab25f67f76b 2023-07-11 20:13:13,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-11 20:13:13,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:13,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 20:13:13,056 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-11 20:13:13,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:13,057 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:13,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689106392849Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689106393005 (+156 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689106393005Loading Region manifests for snaptb0-testExportFileSystemState at 1689106393005Writing data manifest for snaptb0-testExportFileSystemState at 1689106393010 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689106393024 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689106393056 (+32 ms) 2023-07-11 20:13:13,059 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-11 20:13:13,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 210 msec 2023-07-11 20:13:13,152 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:13,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:13:13,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:13,154 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154 2023-07-11 20:13:13,154 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:13:13,181 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:13:13,181 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1807554536_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:13,181 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-11 20:13:13,194 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-11 20:13:13,213 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,213 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,214 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,214 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,214 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,215 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,215 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,286 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-3353007719931306346.jar 2023-07-11 20:13:13,287 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,287 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,288 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,288 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,288 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,289 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:13,289 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:13:13,290 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:13:13,290 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:13:13,290 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:13:13,291 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:13:13,291 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:13:13,292 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:13:13,292 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:13:13,292 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:13:13,293 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:13:13,293 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:13,294 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:13,294 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:13,294 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:13,295 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:13,295 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:13,295 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:13,808 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:13:13,811 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-11 20:13:13,813 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-11 20:13:14,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:14,678 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:14,684 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0001_000001 (auth:SIMPLE) 2023-07-11 20:13:15,450 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:16,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:13:20,120 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:22,393 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:25,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:27,015 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:27,016 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:27,024 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-11 20:13:27,024 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:27,025 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:27,025 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 20:13:27,026 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 20:13:27,026 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 20:13:27,026 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-11 20:13:27,026 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-11 20:13:27,027 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106393154/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-11 20:13:27,034 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-11 20:13:27,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-11 20:13:27,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 20:13:27,041 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106407041"}]},"ts":"1689106407041"} 2023-07-11 20:13:27,043 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 20:13:27,045 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-11 20:13:27,046 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, UNASSIGN}] 2023-07-11 20:13:27,049 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, UNASSIGN 2023-07-11 20:13:27,049 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, UNASSIGN 2023-07-11 20:13:27,050 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4a7ef374f7540a1d0335d6ce238fb54a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:27,050 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f4a0a09ad9fc556b0e862431c024dfa2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:27,050 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106407050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106407050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106407050"}]},"ts":"1689106407050"} 2023-07-11 20:13:27,050 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106407050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106407050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106407050"}]},"ts":"1689106407050"} 2023-07-11 20:13:27,051 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 4a7ef374f7540a1d0335d6ce238fb54a, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:13:27,053 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure f4a0a09ad9fc556b0e862431c024dfa2, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:13:27,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 20:13:27,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:27,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a7ef374f7540a1d0335d6ce238fb54a, disabling compactions & flushes 2023-07-11 20:13:27,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:27,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:27,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. after waiting 0 ms 2023-07-11 20:13:27,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:27,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:27,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4a0a09ad9fc556b0e862431c024dfa2, disabling compactions & flushes 2023-07-11 20:13:27,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:27,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:27,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. after waiting 0 ms 2023-07-11 20:13:27,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:27,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:27,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:27,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:27,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a. 2023-07-11 20:13:27,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a7ef374f7540a1d0335d6ce238fb54a: 2023-07-11 20:13:27,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:27,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2. 2023-07-11 20:13:27,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4a0a09ad9fc556b0e862431c024dfa2: 2023-07-11 20:13:27,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:27,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=4a7ef374f7540a1d0335d6ce238fb54a, regionState=CLOSED 2023-07-11 20:13:27,226 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106407226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106407226"}]},"ts":"1689106407226"} 2023-07-11 20:13:27,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:27,227 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=f4a0a09ad9fc556b0e862431c024dfa2, regionState=CLOSED 2023-07-11 20:13:27,227 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689106407227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106407227"}]},"ts":"1689106407227"} 2023-07-11 20:13:27,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-11 20:13:27,230 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 4a7ef374f7540a1d0335d6ce238fb54a, server=jenkins-hbase4.apache.org,43979,1689106362092 in 177 msec 2023-07-11 20:13:27,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-11 20:13:27,231 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure f4a0a09ad9fc556b0e862431c024dfa2, server=jenkins-hbase4.apache.org,40513,1689106361915 in 176 msec 2023-07-11 20:13:27,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4a7ef374f7540a1d0335d6ce238fb54a, UNASSIGN in 185 msec 2023-07-11 20:13:27,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-11 20:13:27,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f4a0a09ad9fc556b0e862431c024dfa2, UNASSIGN in 185 msec 2023-07-11 20:13:27,236 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106407235"}]},"ts":"1689106407235"} 2023-07-11 20:13:27,243 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 20:13:27,246 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-11 20:13:27,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 212 msec 2023-07-11 20:13:27,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-11 20:13:27,344 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-11 20:13:27,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-11 20:13:27,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,349 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-11 20:13:27,350 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,352 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-11 20:13:27,354 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,354 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,354 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,354 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:27,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:27,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:27,355 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-11 20:13:27,356 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:27,356 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-11 20:13:27,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,358 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 20:13:27,359 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/recovered.edits] 2023-07-11 20:13:27,359 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/recovered.edits] 2023-07-11 20:13:27,364 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf/b422425bff82437c96414f440cd06932 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/cf/b422425bff82437c96414f440cd06932 2023-07-11 20:13:27,364 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf/04abcd4c2e0f4a06af065219452efa51 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/cf/04abcd4c2e0f4a06af065219452efa51 2023-07-11 20:13:27,368 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2/recovered.edits/9.seqid 2023-07-11 20:13:27,368 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a/recovered.edits/9.seqid 2023-07-11 20:13:27,369 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/f4a0a09ad9fc556b0e862431c024dfa2 2023-07-11 20:13:27,369 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemState/4a7ef374f7540a1d0335d6ce238fb54a 2023-07-11 20:13:27,369 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-11 20:13:27,369 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-11 20:13:27,370 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-11 20:13:27,374 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307116f6bcc9e8c634481b32d8837dd22d237 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307116f6bcc9e8c634481b32d8837dd22d237 2023-07-11 20:13:27,376 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ba2f09f537bd4deeb2e9bab25f67f76b to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230711ba2f09f537bd4deeb2e9bab25f67f76b 2023-07-11 20:13:27,376 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-11 20:13:27,379 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,394 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-11 20:13:27,401 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-11 20:13:27,403 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,403 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-11 20:13:27,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106407403"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:27,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106407403"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:27,405 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:13:27,405 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f4a0a09ad9fc556b0e862431c024dfa2, NAME => 'testtb-testExportFileSystemState,,1689106391015.f4a0a09ad9fc556b0e862431c024dfa2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4a7ef374f7540a1d0335d6ce238fb54a, NAME => 'testtb-testExportFileSystemState,1,1689106391015.4a7ef374f7540a1d0335d6ce238fb54a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:13:27,405 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-11 20:13:27,405 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106407405"}]},"ts":"9223372036854775807"} 2023-07-11 20:13:27,407 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-11 20:13:27,410 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-11 20:13:27,417 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 65 msec 2023-07-11 20:13:27,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-11 20:13:27,460 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-11 20:13:27,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-11 20:13:27,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-11 20:13:27,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-11 20:13:27,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-11 20:13:27,511 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 752) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:38471 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_952268853_1 at /127.0.0.1:33094 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:51702 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2142 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:56458 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:33138 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=923 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=441 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 180), AvailableMemoryMB=1631 (was 1994) 2023-07-11 20:13:27,511 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-11 20:13:27,534 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=441, ProcessCount=180, AvailableMemoryMB=1625 2023-07-11 20:13:27,534 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-11 20:13:27,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 20:13:27,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:27,540 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:13:27,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-11 20:13:27,541 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:13:27,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:27,545 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,545 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,545 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 empty. 2023-07-11 20:13:27,546 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c empty. 2023-07-11 20:13:27,546 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,546 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,546 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 20:13:27,563 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-11 20:13:27,564 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f9c1aecb8062bf38c242dd4cf0f0bc8c, NAME => 'testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:13:27,564 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => ac90f4a52a41ff09edd9ffcc2b080b50, NAME => 'testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:13:27,593 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:27,594 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing ac90f4a52a41ff09edd9ffcc2b080b50, disabling compactions & flushes 2023-07-11 20:13:27,594 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,594 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,594 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. after waiting 0 ms 2023-07-11 20:13:27,594 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,594 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,594 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for ac90f4a52a41ff09edd9ffcc2b080b50: 2023-07-11 20:13:27,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:27,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f9c1aecb8062bf38c242dd4cf0f0bc8c, disabling compactions & flushes 2023-07-11 20:13:27,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. after waiting 0 ms 2023-07-11 20:13:27,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,595 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,595 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f9c1aecb8062bf38c242dd4cf0f0bc8c: 2023-07-11 20:13:27,598 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:13:27,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106407599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106407599"}]},"ts":"1689106407599"} 2023-07-11 20:13:27,600 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106407599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106407599"}]},"ts":"1689106407599"} 2023-07-11 20:13:27,602 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:13:27,603 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:13:27,604 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106407603"}]},"ts":"1689106407603"} 2023-07-11 20:13:27,605 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-11 20:13:27,608 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:13:27,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:13:27,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:13:27,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:13:27,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:13:27,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, ASSIGN}] 2023-07-11 20:13:27,612 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, ASSIGN 2023-07-11 20:13:27,613 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, ASSIGN 2023-07-11 20:13:27,614 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40513,1689106361915; forceNewPlan=false, retain=false 2023-07-11 20:13:27,614 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46707,1689106362013; forceNewPlan=false, retain=false 2023-07-11 20:13:27,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:27,764 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:13:27,767 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f9c1aecb8062bf38c242dd4cf0f0bc8c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:27,767 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ac90f4a52a41ff09edd9ffcc2b080b50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:27,767 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106407767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106407767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106407767"}]},"ts":"1689106407767"} 2023-07-11 20:13:27,767 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106407767"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106407767"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106407767"}]},"ts":"1689106407767"} 2023-07-11 20:13:27,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure f9c1aecb8062bf38c242dd4cf0f0bc8c, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:13:27,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure ac90f4a52a41ff09edd9ffcc2b080b50, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:13:27,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:27,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9c1aecb8062bf38c242dd4cf0f0bc8c, NAME => 'testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:13:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. service=AccessControlService 2023-07-11 20:13:27,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac90f4a52a41ff09edd9ffcc2b080b50, NAME => 'testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:13:27,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. service=AccessControlService 2023-07-11 20:13:27,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:13:27,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:13:27,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,929 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,929 INFO [StoreOpener-f9c1aecb8062bf38c242dd4cf0f0bc8c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,930 INFO [StoreOpener-ac90f4a52a41ff09edd9ffcc2b080b50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,931 DEBUG [StoreOpener-f9c1aecb8062bf38c242dd4cf0f0bc8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf 2023-07-11 20:13:27,931 DEBUG [StoreOpener-f9c1aecb8062bf38c242dd4cf0f0bc8c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf 2023-07-11 20:13:27,931 INFO [StoreOpener-f9c1aecb8062bf38c242dd4cf0f0bc8c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9c1aecb8062bf38c242dd4cf0f0bc8c columnFamilyName cf 2023-07-11 20:13:27,932 DEBUG [StoreOpener-ac90f4a52a41ff09edd9ffcc2b080b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf 2023-07-11 20:13:27,932 DEBUG [StoreOpener-ac90f4a52a41ff09edd9ffcc2b080b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf 2023-07-11 20:13:27,932 INFO [StoreOpener-ac90f4a52a41ff09edd9ffcc2b080b50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac90f4a52a41ff09edd9ffcc2b080b50 columnFamilyName cf 2023-07-11 20:13:27,933 INFO [StoreOpener-f9c1aecb8062bf38c242dd4cf0f0bc8c-1] regionserver.HStore(310): Store=f9c1aecb8062bf38c242dd4cf0f0bc8c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:27,933 INFO [StoreOpener-ac90f4a52a41ff09edd9ffcc2b080b50-1] regionserver.HStore(310): Store=ac90f4a52a41ff09edd9ffcc2b080b50/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:13:27,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:27,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:27,939 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9c1aecb8062bf38c242dd4cf0f0bc8c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62759323, jitterRate=-0.06481321156024933}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:27,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:13:27,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9c1aecb8062bf38c242dd4cf0f0bc8c: 2023-07-11 20:13:27,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac90f4a52a41ff09edd9ffcc2b080b50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62979246, jitterRate=-0.06153610348701477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:13:27,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac90f4a52a41ff09edd9ffcc2b080b50: 2023-07-11 20:13:27,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c., pid=45, masterSystemTime=1689106407921 2023-07-11 20:13:27,940 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50., pid=46, masterSystemTime=1689106407922 2023-07-11 20:13:27,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:27,943 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f9c1aecb8062bf38c242dd4cf0f0bc8c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:27,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,943 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106407943"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106407943"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106407943"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106407943"}]},"ts":"1689106407943"} 2023-07-11 20:13:27,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:27,944 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ac90f4a52a41ff09edd9ffcc2b080b50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:27,944 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106407944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106407944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106407944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106407944"}]},"ts":"1689106407944"} 2023-07-11 20:13:27,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-11 20:13:27,950 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure f9c1aecb8062bf38c242dd4cf0f0bc8c, server=jenkins-hbase4.apache.org,40513,1689106361915 in 178 msec 2023-07-11 20:13:27,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-11 20:13:27,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure ac90f4a52a41ff09edd9ffcc2b080b50, server=jenkins-hbase4.apache.org,46707,1689106362013 in 178 msec 2023-07-11 20:13:27,951 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, ASSIGN in 341 msec 2023-07-11 20:13:27,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-11 20:13:27,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, ASSIGN in 342 msec 2023-07-11 20:13:27,954 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:13:27,954 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106407954"}]},"ts":"1689106407954"} 2023-07-11 20:13:27,955 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-11 20:13:27,958 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:13:27,958 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-11 20:13:27,960 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 20:13:27,962 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,962 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,962 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,962 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:13:27,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:27,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:27,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:27,963 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-11 20:13:27,965 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 427 msec 2023-07-11 20:13:28,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-11 20:13:28,147 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-11 20:13:28,149 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 20:13:28,149 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:28,152 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:28,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:28,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106408166 (current time:1689106408166). 2023-07-11 20:13:28,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:28,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x1c65884e to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:28,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a604f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:28,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:28,176 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51446, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:28,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c65884e to 127.0.0.1:53621 2023-07-11 20:13:28,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:28,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x1d693fb2 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:28,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dfef3a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:28,191 DEBUG [hconnection-0x7f04c641-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:28,193 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51454, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:28,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:28,199 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:28,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d693fb2 to 127.0.0.1:53621 2023-07-11 20:13:28,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:28,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 20:13:28,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:28,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:28,205 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:28,206 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689107008206 2023-07-11 20:13:28,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 20:13:28,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:28,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:28,208 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:28,208 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:28,209 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:28,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-11 20:13:28,211 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:28,212 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689107008212 2023-07-11 20:13:28,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,225 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-11 20:13:28,225 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,226 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 20:13:28,226 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 20:13:28,227 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,227 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,228 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,228 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,228 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,228 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,228 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,229 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,229 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,229 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 20:13:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,230 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,230 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:28,231 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:28,234 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:28,235 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:28,235 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:28,236 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,236 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,236 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,236 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@600177cf[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:28,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@600177cf[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:28,242 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 20:13:28,242 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,244 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:28,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:28,245 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. started... 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:13:28,245 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:28,245 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. started... 2023-07-11 20:13:28,245 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:28,246 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:28,245 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:28,246 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac90f4a52a41ff09edd9ffcc2b080b50: 2023-07-11 20:13:28,246 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9c1aecb8062bf38c242dd4cf0f0bc8c: 2023-07-11 20:13:28,246 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,246 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,247 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:28,247 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:28,247 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:28,247 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:13:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,251 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:28,265 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. completed. 2023-07-11 20:13:28,265 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:28,265 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. completed. 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,265 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:28,265 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:13:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:28,267 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,267 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,267 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:28,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:13:28,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 20:13:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46707,1689106362013': 2023-07-11 20:13:28,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 20:13:28,281 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-11 20:13:28,281 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:28,281 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:28,281 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,281 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,285 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,287 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,291 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,292 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,292 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,296 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,296 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,297 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-11 20:13:28,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,296 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,297 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,298 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 20:13:28,308 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:28,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:28,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:28,309 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:28,311 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,351 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 20:13:28,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,352 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-11 20:13:28,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689106408206Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689106408311 (+105 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689106408311Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689106408311Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689106408315 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689106408327 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689106408351 (+24 ms) 2023-07-11 20:13:28,357 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:28,358 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 150 msec 2023-07-11 20:13:28,510 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:28,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:28,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:28,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:28,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40513] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:13:28,518 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-11 20:13:28,518 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:28,518 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:13:28,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:28,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106408529 (current time:1689106408529). 2023-07-11 20:13:28,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:13:28,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x5779b32f to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:28,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c1508cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:28,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:28,544 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51458, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:28,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5779b32f to 127.0.0.1:53621 2023-07-11 20:13:28,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:28,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x5ae812e9 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:13:28,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40922250, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:13:28,555 DEBUG [hconnection-0x141511e6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:28,558 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:28,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:13:28,562 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:13:28,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ae812e9 to 127.0.0.1:53621 2023-07-11 20:13:28,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:13:28,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-11 20:13:28,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:13:28,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:28,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:28,568 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:28,568 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689107008568 2023-07-11 20:13:28,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-11 20:13:28,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-11 20:13:28,570 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:13:28,570 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:13:28,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:28,571 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-11 20:13:28,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-11 20:13:28,573 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:28,574 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689107008574 2023-07-11 20:13:28,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-11 20:13:28,588 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-11 20:13:28,588 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,590 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-11 20:13:28,590 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-11 20:13:28,590 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,590 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,592 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,592 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,592 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,592 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,592 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,592 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,593 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 20:13:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:28,594 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 20:13:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,594 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,596 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-11 20:13:28,596 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-11 20:13:28,597 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:28,597 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:28,597 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:28,598 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:28,597 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:13:28,598 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:28,598 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-11 20:13:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-11 20:13:28,599 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-11 20:13:28,601 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,603 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,603 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,603 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:28,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,604 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:13:28,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:28,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55d1c7bc[Count = 1] remaining members to acquire global barrier 2023-07-11 20:13:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-11 20:13:28,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55d1c7bc[Count = 0] remaining members to acquire global barrier 2023-07-11 20:13:28,611 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-11 20:13:28,611 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:28,613 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,613 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:28,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:13:28,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-11 20:13:28,614 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,614 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:13:28,614 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:28,614 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:13:28,614 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:28,614 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. started... 2023-07-11 20:13:28,615 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. started... 2023-07-11 20:13:28,615 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f9c1aecb8062bf38c242dd4cf0f0bc8c 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 20:13:28,615 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ac90f4a52a41ff09edd9ffcc2b080b50 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 20:13:28,616 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:28,616 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,616 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:28,658 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307113f1a507f7ab848d4a8f8e9ffe2e07a2c to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307113f1a507f7ab848d4a8f8e9ffe2e07a2c 2023-07-11 20:13:28,661 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307116203528d22de4ceaafa89129b35e3523 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307116203528d22de4ceaafa89129b35e3523 2023-07-11 20:13:28,667 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/.tmp/cf/7230555619bd45c0928c936ac7bf097c 2023-07-11 20:13:28,670 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:28,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:28,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:13:28,672 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/.tmp/cf/0f432f1c8bb741b8b2479547f430146d 2023-07-11 20:13:28,672 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:13:28,673 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/.tmp/cf/7230555619bd45c0928c936ac7bf097c as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf/7230555619bd45c0928c936ac7bf097c 2023-07-11 20:13:28,677 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/.tmp/cf/0f432f1c8bb741b8b2479547f430146d as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf/0f432f1c8bb741b8b2479547f430146d 2023-07-11 20:13:28,679 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf/7230555619bd45c0928c936ac7bf097c, entries=2, sequenceid=6, filesize=5.2 K 2023-07-11 20:13:28,680 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for ac90f4a52a41ff09edd9ffcc2b080b50 in 65ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:28,680 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-11 20:13:28,680 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ac90f4a52a41ff09edd9ffcc2b080b50: 2023-07-11 20:13:28,680 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:28,680 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:28,680 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf/7230555619bd45c0928c936ac7bf097c] hfiles 2023-07-11 20:13:28,680 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf/7230555619bd45c0928c936ac7bf097c for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:28,683 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf/0f432f1c8bb741b8b2479547f430146d, entries=48, sequenceid=6, filesize=12.9 K 2023-07-11 20:13:28,684 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f9c1aecb8062bf38c242dd4cf0f0bc8c in 69ms, sequenceid=6, compaction requested=false 2023-07-11 20:13:28,685 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9c1aecb8062bf38c242dd4cf0f0bc8c: 2023-07-11 20:13:28,685 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:28,685 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:13:28,686 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf/0f432f1c8bb741b8b2479547f430146d] hfiles 2023-07-11 20:13:28,686 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf/0f432f1c8bb741b8b2479547f430146d for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:28,690 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. completed. 2023-07-11 20:13:28,690 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:28,690 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:13:28,692 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:28,692 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,692 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,693 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,46707,1689106362013': 2023-07-11 20:13:28,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-11 20:13:28,699 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. completed. 2023-07-11 20:13:28,699 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:28,699 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:13:28,699 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:13:28,699 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,699 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-11 20:13:28,699 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:13:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-11 20:13:28,702 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,702 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-11 20:13:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:13:28,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-11 20:13:28,707 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-11 20:13:28,707 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:13:28,707 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:13:28,707 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-11 20:13:28,707 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:13:28,710 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,709 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:13:28,710 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:13:28,710 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:13:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,712 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:13:28,713 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-11 20:13:28,713 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:13:28,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:13:28,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,719 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:13:28,720 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,720 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-11 20:13:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:13:28,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,720 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:13:28,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-11 20:13:28,722 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:13:28,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,720 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:13:28,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,722 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307116203528d22de4ceaafa89129b35e3523, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307113f1a507f7ab848d4a8f8e9ffe2e07a2c] mob files 2023-07-11 20:13:28,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307116203528d22de4ceaafa89129b35e3523 2023-07-11 20:13:28,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307113f1a507f7ab848d4a8f8e9ffe2e07a2c 2023-07-11 20:13:28,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-11 20:13:28,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-11 20:13:28,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,784 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689106408569Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689106408737 (+168 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689106408737Loading Region manifests for snaptb0-testConsecutiveExports at 1689106408737Writing data manifest for snaptb0-testConsecutiveExports at 1689106408742 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689106408752 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689106408784 (+32 ms) 2023-07-11 20:13:28,787 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-11 20:13:28,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 217 msec 2023-07-11 20:13:28,872 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:13:28,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-11 20:13:28,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:13:28,873 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873 2023-07-11 20:13:28,874 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:13:28,896 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:13:28,896 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@763070c0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,897 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 20:13:28,905 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:28,917 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,918 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,918 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,918 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,919 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,919 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,919 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,993 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-2015335456063085531.jar 2023-07-11 20:13:28,994 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,994 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,994 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,995 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,995 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,995 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:28,996 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:13:28,996 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:13:28,997 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:13:28,997 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:13:28,997 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:13:28,998 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:13:28,998 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:13:28,998 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:13:28,999 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:13:28,999 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:13:29,000 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:29,000 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:29,001 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:29,001 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:29,001 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:29,002 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:29,002 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:29,368 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:13:29,371 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 20:13:29,373 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-11 20:13:31,399 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:31,400 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:31,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0002_000001 (auth:SIMPLE) 2023-07-11 20:13:31,690 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:32,837 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:13:36,150 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:38,409 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:41,754 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:43,558 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:43,558 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:43,562 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 20:13:43,563 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:43,563 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:43,563 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:43,564 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:43,564 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:43,564 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2598c3d8 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:43,564 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:43,564 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:43,566 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:13:43,587 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:13:43,587 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5f310b4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:43,587 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-11 20:13:43,600 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-11 20:13:43,613 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,613 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,614 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,614 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,615 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,615 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,616 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,688 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-5699259192699011181.jar 2023-07-11 20:13:43,688 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,688 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,689 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,689 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,689 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,690 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:13:43,690 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:13:43,690 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:13:43,691 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:13:43,691 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:13:43,691 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:13:43,692 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:13:43,692 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:13:43,692 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:13:43,693 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:13:43,693 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:13:43,694 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:43,694 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:43,694 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:43,695 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:43,695 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:13:43,695 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:43,696 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:13:44,474 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:13:44,477 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-11 20:13:44,479 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-11 20:13:47,849 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:47,849 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:13:47,852 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0003_000001 (auth:SIMPLE) 2023-07-11 20:13:48,697 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:53,024 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:55,320 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:57,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0004_000001 (auth:SIMPLE) 2023-07-11 20:13:59,675 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:13:59,675 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:13:59,681 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-11 20:13:59,681 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:13:59,681 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:13:59,681 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:59,684 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:59,684 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:59,684 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@2598c3d8 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-11 20:13:59,685 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-11 20:13:59,685 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/local-export-1689106408873/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-11 20:13:59,702 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-11 20:13:59,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-11 20:13:59,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:13:59,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 20:13:59,712 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106439712"}]},"ts":"1689106439712"} 2023-07-11 20:13:59,714 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-11 20:13:59,717 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-11 20:13:59,719 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, UNASSIGN}] 2023-07-11 20:13:59,722 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, UNASSIGN 2023-07-11 20:13:59,722 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, UNASSIGN 2023-07-11 20:13:59,723 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f9c1aecb8062bf38c242dd4cf0f0bc8c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:13:59,724 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ac90f4a52a41ff09edd9ffcc2b080b50, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:13:59,724 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106439723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106439723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106439723"}]},"ts":"1689106439723"} 2023-07-11 20:13:59,724 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106439723"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106439723"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106439723"}]},"ts":"1689106439723"} 2023-07-11 20:13:59,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure f9c1aecb8062bf38c242dd4cf0f0bc8c, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:13:59,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure ac90f4a52a41ff09edd9ffcc2b080b50, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:13:59,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 20:13:59,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9c1aecb8062bf38c242dd4cf0f0bc8c, disabling compactions & flushes 2023-07-11 20:13:59,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:59,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac90f4a52a41ff09edd9ffcc2b080b50, disabling compactions & flushes 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. after waiting 0 ms 2023-07-11 20:13:59,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. after waiting 0 ms 2023-07-11 20:13:59,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:59,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:59,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:13:59,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:59,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:13:59,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c. 2023-07-11 20:13:59,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50. 2023-07-11 20:13:59,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9c1aecb8062bf38c242dd4cf0f0bc8c: 2023-07-11 20:13:59,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac90f4a52a41ff09edd9ffcc2b080b50: 2023-07-11 20:13:59,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:13:59,913 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f9c1aecb8062bf38c242dd4cf0f0bc8c, regionState=CLOSED 2023-07-11 20:13:59,914 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106439913"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106439913"}]},"ts":"1689106439913"} 2023-07-11 20:13:59,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:13:59,914 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ac90f4a52a41ff09edd9ffcc2b080b50, regionState=CLOSED 2023-07-11 20:13:59,914 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689106439914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106439914"}]},"ts":"1689106439914"} 2023-07-11 20:13:59,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-11 20:13:59,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure f9c1aecb8062bf38c242dd4cf0f0bc8c, server=jenkins-hbase4.apache.org,40513,1689106361915 in 190 msec 2023-07-11 20:13:59,920 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-11 20:13:59,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure ac90f4a52a41ff09edd9ffcc2b080b50, server=jenkins-hbase4.apache.org,46707,1689106362013 in 191 msec 2023-07-11 20:13:59,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f9c1aecb8062bf38c242dd4cf0f0bc8c, UNASSIGN in 200 msec 2023-07-11 20:13:59,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-11 20:13:59,923 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ac90f4a52a41ff09edd9ffcc2b080b50, UNASSIGN in 202 msec 2023-07-11 20:13:59,923 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106439923"}]},"ts":"1689106439923"} 2023-07-11 20:13:59,925 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-11 20:13:59,927 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-11 20:13:59,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 225 msec 2023-07-11 20:14:00,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-11 20:14:00,014 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-11 20:14:00,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-11 20:14:00,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:14:00,020 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:14:00,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-11 20:14:00,021 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:14:00,025 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-11 20:14:00,030 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,030 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,030 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,030 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:14:00,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:14:00,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:14:00,031 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-11 20:14:00,032 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,033 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-11 20:14:00,034 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 20:14:00,036 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/recovered.edits] 2023-07-11 20:14:00,048 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:14:00,053 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf/7230555619bd45c0928c936ac7bf097c to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/cf/7230555619bd45c0928c936ac7bf097c 2023-07-11 20:14:00,053 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/recovered.edits] 2023-07-11 20:14:00,062 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50/recovered.edits/9.seqid 2023-07-11 20:14:00,063 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf/0f432f1c8bb741b8b2479547f430146d to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/cf/0f432f1c8bb741b8b2479547f430146d 2023-07-11 20:14:00,063 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/ac90f4a52a41ff09edd9ffcc2b080b50 2023-07-11 20:14:00,067 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c/recovered.edits/9.seqid 2023-07-11 20:14:00,068 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testConsecutiveExports/f9c1aecb8062bf38c242dd4cf0f0bc8c 2023-07-11 20:14:00,068 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-11 20:14:00,069 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-11 20:14:00,070 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-11 20:14:00,075 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307116203528d22de4ceaafa89129b35e3523 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307116203528d22de4ceaafa89129b35e3523 2023-07-11 20:14:00,077 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307113f1a507f7ab848d4a8f8e9ffe2e07a2c to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307113f1a507f7ab848d4a8f8e9ffe2e07a2c 2023-07-11 20:14:00,077 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-11 20:14:00,081 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:14:00,086 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-11 20:14:00,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-11 20:14:00,093 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:14:00,093 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-11 20:14:00,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106440093"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:00,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106440093"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:00,117 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:00,117 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ac90f4a52a41ff09edd9ffcc2b080b50, NAME => 'testtb-testConsecutiveExports,,1689106407536.ac90f4a52a41ff09edd9ffcc2b080b50.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f9c1aecb8062bf38c242dd4cf0f0bc8c, NAME => 'testtb-testConsecutiveExports,1,1689106407536.f9c1aecb8062bf38c242dd4cf0f0bc8c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:00,117 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-11 20:14:00,117 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106440117"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:00,120 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-11 20:14:00,128 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-11 20:14:00,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 112 msec 2023-07-11 20:14:00,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-11 20:14:00,136 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-11 20:14:00,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-11 20:14:00,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-11 20:14:00,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-11 20:14:00,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-11 20:14:00,192 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=898 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=413 (was 441), ProcessCount=184 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=2141 (was 1625) - AvailableMemoryMB LEAK? - 2023-07-11 20:14:00,192 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-11 20:14:00,224 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=413, ProcessCount=184, AvailableMemoryMB=2132 2023-07-11 20:14:00,224 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-11 20:14:00,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 20:14:00,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,231 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:00,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-11 20:14:00,232 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:00,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:14:00,236 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,236 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,237 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 empty. 2023-07-11 20:14:00,237 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d empty. 2023-07-11 20:14:00,238 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,238 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,238 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 20:14:00,259 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:00,260 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f7c8b81c982dab57e08f2f20ae4db760, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:00,260 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f4338ea461f39021eac0571a1fa86e4d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f4338ea461f39021eac0571a1fa86e4d, disabling compactions & flushes 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f7c8b81c982dab57e08f2f20ae4db760, disabling compactions & flushes 2023-07-11 20:14:00,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. after waiting 0 ms 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. after waiting 0 ms 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,309 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,309 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,310 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f7c8b81c982dab57e08f2f20ae4db760: 2023-07-11 20:14:00,310 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f4338ea461f39021eac0571a1fa86e4d: 2023-07-11 20:14:00,313 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:00,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106440314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106440314"}]},"ts":"1689106440314"} 2023-07-11 20:14:00,314 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106440314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106440314"}]},"ts":"1689106440314"} 2023-07-11 20:14:00,324 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:00,327 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:00,328 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106440327"}]},"ts":"1689106440327"} 2023-07-11 20:14:00,329 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-11 20:14:00,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:14:00,334 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:00,336 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:00,336 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:00,336 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:00,336 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:00,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, ASSIGN}] 2023-07-11 20:14:00,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, ASSIGN 2023-07-11 20:14:00,349 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, ASSIGN 2023-07-11 20:14:00,350 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:14:00,350 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40513,1689106361915; forceNewPlan=false, retain=false 2023-07-11 20:14:00,500 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:00,503 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f4338ea461f39021eac0571a1fa86e4d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:00,503 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f7c8b81c982dab57e08f2f20ae4db760, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:00,503 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106440503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106440503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106440503"}]},"ts":"1689106440503"} 2023-07-11 20:14:00,503 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106440503"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106440503"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106440503"}]},"ts":"1689106440503"} 2023-07-11 20:14:00,506 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure f4338ea461f39021eac0571a1fa86e4d, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:00,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure f7c8b81c982dab57e08f2f20ae4db760, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:14:00,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:14:00,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f4338ea461f39021eac0571a1fa86e4d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:14:00,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. service=AccessControlService 2023-07-11 20:14:00,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:00,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:00,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7c8b81c982dab57e08f2f20ae4db760, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:14:00,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. service=AccessControlService 2023-07-11 20:14:00,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:00,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:00,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,675 INFO [StoreOpener-f7c8b81c982dab57e08f2f20ae4db760-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,677 DEBUG [StoreOpener-f7c8b81c982dab57e08f2f20ae4db760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf 2023-07-11 20:14:00,677 DEBUG [StoreOpener-f7c8b81c982dab57e08f2f20ae4db760-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf 2023-07-11 20:14:00,678 INFO [StoreOpener-f7c8b81c982dab57e08f2f20ae4db760-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7c8b81c982dab57e08f2f20ae4db760 columnFamilyName cf 2023-07-11 20:14:00,684 INFO [StoreOpener-f4338ea461f39021eac0571a1fa86e4d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,691 DEBUG [StoreOpener-f4338ea461f39021eac0571a1fa86e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf 2023-07-11 20:14:00,691 DEBUG [StoreOpener-f4338ea461f39021eac0571a1fa86e4d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf 2023-07-11 20:14:00,691 INFO [StoreOpener-f7c8b81c982dab57e08f2f20ae4db760-1] regionserver.HStore(310): Store=f7c8b81c982dab57e08f2f20ae4db760/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:00,691 INFO [StoreOpener-f4338ea461f39021eac0571a1fa86e4d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f4338ea461f39021eac0571a1fa86e4d columnFamilyName cf 2023-07-11 20:14:00,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,696 INFO [StoreOpener-f4338ea461f39021eac0571a1fa86e4d-1] regionserver.HStore(310): Store=f4338ea461f39021eac0571a1fa86e4d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:00,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:00,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:00,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7c8b81c982dab57e08f2f20ae4db760; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61534768, jitterRate=-0.08306050300598145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:00,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7c8b81c982dab57e08f2f20ae4db760: 2023-07-11 20:14:00,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760., pid=61, masterSystemTime=1689106440659 2023-07-11 20:14:00,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f7c8b81c982dab57e08f2f20ae4db760, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:00,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106440709"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106440709"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106440709"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106440709"}]},"ts":"1689106440709"} 2023-07-11 20:14:00,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:00,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-11 20:14:00,714 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure f7c8b81c982dab57e08f2f20ae4db760, server=jenkins-hbase4.apache.org,40513,1689106361915 in 205 msec 2023-07-11 20:14:00,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, ASSIGN in 378 msec 2023-07-11 20:14:00,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:00,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f4338ea461f39021eac0571a1fa86e4d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67716103, jitterRate=0.009048566222190857}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:00,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f4338ea461f39021eac0571a1fa86e4d: 2023-07-11 20:14:00,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d., pid=60, masterSystemTime=1689106440658 2023-07-11 20:14:00,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:00,728 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f4338ea461f39021eac0571a1fa86e4d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:00,729 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106440728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106440728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106440728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106440728"}]},"ts":"1689106440728"} 2023-07-11 20:14:00,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-11 20:14:00,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure f4338ea461f39021eac0571a1fa86e4d, server=jenkins-hbase4.apache.org,43979,1689106362092 in 225 msec 2023-07-11 20:14:00,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-11 20:14:00,748 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, ASSIGN in 404 msec 2023-07-11 20:14:00,749 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:00,749 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106440749"}]},"ts":"1689106440749"} 2023-07-11 20:14:00,752 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-11 20:14:00,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:00,756 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-11 20:14:00,759 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 20:14:00,761 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,761 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,761 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,761 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:00,762 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:00,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:00,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:00,763 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:00,765 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 536 msec 2023-07-11 20:14:00,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-11 20:14:00,837 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-11 20:14:00,842 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,843 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:00,845 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:00,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:14:00,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106440877 (current time:1689106440877). 2023-07-11 20:14:00,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:00,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x5bc03826 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:00,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ca13a4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:00,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:00,898 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bc03826 to 127.0.0.1:53621 2023-07-11 20:14:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:00,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x77823f7d to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:00,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dd928a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:00,927 DEBUG [hconnection-0x68ef2438-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:00,928 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:00,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:00,951 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:00,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77823f7d to 127.0.0.1:53621 2023-07-11 20:14:00,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:00,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 20:14:00,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:00,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:14:00,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:14:00,963 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:14:00,964 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689107040964 2023-07-11 20:14:00,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:14:00,965 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:00,967 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:00,967 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:00,969 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:14:00,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:00,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-11 20:14:00,971 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:00,972 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689107040972 2023-07-11 20:14:01,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,047 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 20:14:01,047 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,049 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 20:14:01,049 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 20:14:01,049 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,050 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,051 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,052 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,052 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,052 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,053 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,053 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,053 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,054 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,054 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:14:01,055 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:14:01,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,060 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:14:01,060 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,060 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,060 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:14:01,060 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:14:01,068 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:14:01,068 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:14:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:14:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:14:01,068 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:14:01,069 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:14:01,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:01,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:01,071 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,072 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:14:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:14:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:14:01,073 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,073 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,074 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,074 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:01,074 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,074 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:01,076 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,076 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,077 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,077 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:14:01,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a524ae5[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:14:01,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a524ae5[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:01,083 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 20:14:01,083 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:14:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:14:01,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:01,085 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,085 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:14:01,087 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,087 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:01,090 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:01,091 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:01,091 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:01,091 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. started... 2023-07-11 20:14:01,093 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:01,096 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:01,096 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4338ea461f39021eac0571a1fa86e4d: 2023-07-11 20:14:01,096 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:01,096 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:01,096 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:01,098 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,098 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:01,098 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:01,098 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:01,098 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. started... 2023-07-11 20:14:01,099 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7c8b81c982dab57e08f2f20ae4db760: 2023-07-11 20:14:01,099 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,099 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:01,099 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:01,236 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. completed. 2023-07-11 20:14:01,236 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:01,237 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:01,238 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. completed. 2023-07-11 20:14:01,238 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:01,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:01,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:01,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:01,239 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:01,240 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:01,240 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:01,240 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,240 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:01,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,244 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,245 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:01,245 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:01,245 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:14:01,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 20:14:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:14:01,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 20:14:01,257 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 20:14:01,257 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:01,257 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:01,257 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,257 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:01,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:01,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,273 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:01,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:01,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:01,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:01,273 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:01,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:01,274 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:01,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,275 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:01,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,279 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,281 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,281 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:01,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,286 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:01,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:14:01,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,288 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,288 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,288 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,288 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,288 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,288 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,289 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,289 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,289 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,289 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:01,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:01,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:01,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:01,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:01,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 20:14:01,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:01,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:01,308 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,347 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 20:14:01,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,453 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689106440965Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689106441308 (+343 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106441308Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106441308Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106441320 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689106441335 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689106441452 (+117 ms) 2023-07-11 20:14:01,456 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:01,458 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 489 msec 2023-07-11 20:14:01,575 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:01,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:01,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:01,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:01,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43979] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:01,584 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,585 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:01,585 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:01,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:14:01,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106441603 (current time:1689106441603). 2023-07-11 20:14:01,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:01,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x64210da6 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:01,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5abf7ed2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:01,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:01,621 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:01,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64210da6 to 127.0.0.1:53621 2023-07-11 20:14:01,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:01,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x7b934174 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:01,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17333f9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:01,643 DEBUG [hconnection-0x365b8a47-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:01,652 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:01,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:01,666 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:01,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b934174 to 127.0.0.1:53621 2023-07-11 20:14:01,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:01,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-11 20:14:01,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:01,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:14:01,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:14:01,678 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:14:01,679 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689107041679 2023-07-11 20:14:01,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-11 20:14:01,682 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:01,682 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:01,684 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:01,686 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-11 20:14:01,688 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-11 20:14:01,689 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:01,690 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689107041690 2023-07-11 20:14:01,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,751 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-11 20:14:01,751 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,752 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-11 20:14:01,752 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-11 20:14:01,753 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,753 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,755 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,755 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,755 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,755 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:01,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,756 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,756 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,756 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,757 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,758 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:01,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,758 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:14:01,758 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,760 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:14:01,760 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:14:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-11 20:14:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,760 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:14:01,761 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:14:01,761 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-11 20:14:01,761 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,762 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,763 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:01,768 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:14:01,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,768 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:14:01,768 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-11 20:14:01,768 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:14:01,768 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:01,769 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-11 20:14:01,769 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-11 20:14:01,770 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-11 20:14:01,772 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,772 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,773 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,774 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,774 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:14:01,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a39d4b9[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:01,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-11 20:14:01,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a39d4b9[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:01,779 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-11 20:14:01,779 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:14:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,780 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:01,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,780 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:01,780 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:14:01,781 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,781 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:01,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,781 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-11 20:14:01,782 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:01,782 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:01,782 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:01,782 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:01,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:01,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:01,786 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:01,786 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:01,786 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:01,802 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:01,803 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:01,803 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:01,803 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. started... 2023-07-11 20:14:01,803 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f7c8b81c982dab57e08f2f20ae4db760 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 20:14:01,803 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:01,804 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. started... 2023-07-11 20:14:01,804 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f4338ea461f39021eac0571a1fa86e4d 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 20:14:01,909 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711c3717eeb7f0147949e49f28603138fc8 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230711c3717eeb7f0147949e49f28603138fc8 2023-07-11 20:14:01,922 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071183946b6f169243a68e9e8a43c8dcf25b to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071183946b6f169243a68e9e8a43c8dcf25b 2023-07-11 20:14:01,943 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/.tmp/cf/8c5387d68b8844ec8588ef1bc35a9c04 2023-07-11 20:14:01,952 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/.tmp/cf/8c5387d68b8844ec8588ef1bc35a9c04 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf/8c5387d68b8844ec8588ef1bc35a9c04 2023-07-11 20:14:01,955 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/.tmp/cf/234a7923daac46adb6cf54b1bae02e45 2023-07-11 20:14:01,958 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf/8c5387d68b8844ec8588ef1bc35a9c04, entries=3, sequenceid=6, filesize=5.4 K 2023-07-11 20:14:01,959 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f7c8b81c982dab57e08f2f20ae4db760 in 156ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:01,959 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-11 20:14:01,960 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7c8b81c982dab57e08f2f20ae4db760: 2023-07-11 20:14:01,960 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,960 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:01,960 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf/8c5387d68b8844ec8588ef1bc35a9c04] hfiles 2023-07-11 20:14:01,960 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf/8c5387d68b8844ec8588ef1bc35a9c04 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,961 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/.tmp/cf/234a7923daac46adb6cf54b1bae02e45 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf/234a7923daac46adb6cf54b1bae02e45 2023-07-11 20:14:01,973 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf/234a7923daac46adb6cf54b1bae02e45, entries=47, sequenceid=6, filesize=13.5 K 2023-07-11 20:14:01,974 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f4338ea461f39021eac0571a1fa86e4d in 170ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:01,976 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f4338ea461f39021eac0571a1fa86e4d: 2023-07-11 20:14:01,977 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,977 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:01,977 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf/234a7923daac46adb6cf54b1bae02e45] hfiles 2023-07-11 20:14:01,977 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf/234a7923daac46adb6cf54b1bae02e45 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,980 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. completed. 2023-07-11 20:14:01,980 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:01,980 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:01,981 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:01,982 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:01,982 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,983 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:01,983 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:01,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:01,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:01,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:01,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:01,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:01,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:01,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:01,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:14:01,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-11 20:14:01,992 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:01,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:01,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:01,994 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:02,022 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. completed. 2023-07-11 20:14:02,022 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:02,022 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,023 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-11 20:14:02,023 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:02,024 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-11 20:14:02,024 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,024 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:02,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,025 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-11 20:14:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:02,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:02,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:02,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:14:02,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-11 20:14:02,030 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-11 20:14:02,030 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:02,030 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:02,030 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,030 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:02,037 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:02,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:02,037 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,037 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:02,038 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,038 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,038 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,039 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:02,041 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,041 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,042 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:02,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:14:02,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,045 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:02,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:02,045 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,048 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,048 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,049 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,049 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,049 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,049 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:02,049 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,049 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230711c3717eeb7f0147949e49f28603138fc8, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071183946b6f169243a68e9e8a43c8dcf25b] mob files 2023-07-11 20:14:02,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230711c3717eeb7f0147949e49f28603138fc8 2023-07-11 20:14:02,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071183946b6f169243a68e9e8a43c8dcf25b 2023-07-11 20:14:02,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:02,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:02,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,185 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-11 20:14:02,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,247 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:02,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689106441680Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689106442074 (+394 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689106442074Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689106442075 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689106442111 (+36 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689106442157 (+46 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689106442246 (+89 ms) 2023-07-11 20:14:02,251 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-11 20:14:02,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 569 msec 2023-07-11 20:14:02,295 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:02,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-11 20:14:02,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:02,341 DEBUG [Listener at jenkins-hbase4.apache.org/34985] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:14:02,346 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:14:02,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40513] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 20:14:02,349 DEBUG [Listener at jenkins-hbase4.apache.org/34985] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:14:02,353 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:14:02,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43979] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 20:14:02,354 DEBUG [Listener at jenkins-hbase4.apache.org/34985] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-11 20:14:02,358 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-11 20:14:02,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-11 20:14:02,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-11 20:14:02,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,363 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:02,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-11 20:14:02,364 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:02,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:02,368 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,370 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a empty. 2023-07-11 20:14:02,371 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,371 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,371 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 empty. 2023-07-11 20:14:02,372 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,372 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 20:14:02,416 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:02,419 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => e2b58c8b19e6c2759635d0da272b397a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:02,419 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => cffafb0cb776893bc22a34fc94c709c5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing e2b58c8b19e6c2759635d0da272b397a, disabling compactions & flushes 2023-07-11 20:14:02,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. after waiting 0 ms 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for e2b58c8b19e6c2759635d0da272b397a: 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing cffafb0cb776893bc22a34fc94c709c5, disabling compactions & flushes 2023-07-11 20:14:02,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. after waiting 0 ms 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for cffafb0cb776893bc22a34fc94c709c5: 2023-07-11 20:14:02,431 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:02,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106442432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106442432"}]},"ts":"1689106442432"} 2023-07-11 20:14:02,432 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106442432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106442432"}]},"ts":"1689106442432"} 2023-07-11 20:14:02,434 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:02,434 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:02,435 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106442435"}]},"ts":"1689106442435"} 2023-07-11 20:14:02,436 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-11 20:14:02,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:02,490 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:02,492 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:02,492 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:02,492 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:02,492 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:02,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, ASSIGN}] 2023-07-11 20:14:02,517 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, ASSIGN 2023-07-11 20:14:02,517 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, ASSIGN 2023-07-11 20:14:02,518 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46707,1689106362013; forceNewPlan=false, retain=false 2023-07-11 20:14:02,518 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:14:02,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:02,668 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:02,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e2b58c8b19e6c2759635d0da272b397a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,671 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=cffafb0cb776893bc22a34fc94c709c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106442671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106442671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106442671"}]},"ts":"1689106442671"} 2023-07-11 20:14:02,671 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106442671"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106442671"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106442671"}]},"ts":"1689106442671"} 2023-07-11 20:14:02,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure e2b58c8b19e6c2759635d0da272b397a, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:02,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure cffafb0cb776893bc22a34fc94c709c5, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:14:02,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e2b58c8b19e6c2759635d0da272b397a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.', STARTKEY => '', ENDKEY => '2'} 2023-07-11 20:14:02,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cffafb0cb776893bc22a34fc94c709c5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.', STARTKEY => '2', ENDKEY => ''} 2023-07-11 20:14:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. service=AccessControlService 2023-07-11 20:14:02,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. service=AccessControlService 2023-07-11 20:14:02,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,831 INFO [StoreOpener-cffafb0cb776893bc22a34fc94c709c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,832 DEBUG [StoreOpener-cffafb0cb776893bc22a34fc94c709c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf 2023-07-11 20:14:02,833 DEBUG [StoreOpener-cffafb0cb776893bc22a34fc94c709c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf 2023-07-11 20:14:02,833 INFO [StoreOpener-cffafb0cb776893bc22a34fc94c709c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cffafb0cb776893bc22a34fc94c709c5 columnFamilyName cf 2023-07-11 20:14:02,834 INFO [StoreOpener-cffafb0cb776893bc22a34fc94c709c5-1] regionserver.HStore(310): Store=cffafb0cb776893bc22a34fc94c709c5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:02,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,835 INFO [StoreOpener-e2b58c8b19e6c2759635d0da272b397a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,836 DEBUG [StoreOpener-e2b58c8b19e6c2759635d0da272b397a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf 2023-07-11 20:14:02,837 DEBUG [StoreOpener-e2b58c8b19e6c2759635d0da272b397a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf 2023-07-11 20:14:02,837 INFO [StoreOpener-e2b58c8b19e6c2759635d0da272b397a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e2b58c8b19e6c2759635d0da272b397a columnFamilyName cf 2023-07-11 20:14:02,837 INFO [StoreOpener-e2b58c8b19e6c2759635d0da272b397a-1] regionserver.HStore(310): Store=e2b58c8b19e6c2759635d0da272b397a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:02,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:02,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:02,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cffafb0cb776893bc22a34fc94c709c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61675447, jitterRate=-0.08096422255039215}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:02,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cffafb0cb776893bc22a34fc94c709c5: 2023-07-11 20:14:02,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5., pid=70, masterSystemTime=1689106442825 2023-07-11 20:14:02,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:02,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:02,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=cffafb0cb776893bc22a34fc94c709c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:02,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:02,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106442843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106442843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106442843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106442843"}]},"ts":"1689106442843"} 2023-07-11 20:14:02,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e2b58c8b19e6c2759635d0da272b397a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64143981, jitterRate=-0.04418019950389862}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:02,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e2b58c8b19e6c2759635d0da272b397a: 2023-07-11 20:14:02,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a., pid=69, masterSystemTime=1689106442824 2023-07-11 20:14:02,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,846 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:02,846 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=e2b58c8b19e6c2759635d0da272b397a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:02,846 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106442846"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106442846"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106442846"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106442846"}]},"ts":"1689106442846"} 2023-07-11 20:14:02,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-11 20:14:02,847 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure cffafb0cb776893bc22a34fc94c709c5, server=jenkins-hbase4.apache.org,46707,1689106362013 in 172 msec 2023-07-11 20:14:02,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, ASSIGN in 355 msec 2023-07-11 20:14:02,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-11 20:14:02,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure e2b58c8b19e6c2759635d0da272b397a, server=jenkins-hbase4.apache.org,43979,1689106362092 in 174 msec 2023-07-11 20:14:02,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-11 20:14:02,851 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, ASSIGN in 357 msec 2023-07-11 20:14:02,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:02,851 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106442851"}]},"ts":"1689106442851"} 2023-07-11 20:14:02,852 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-11 20:14:02,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:02,916 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-11 20:14:02,918 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 20:14:02,929 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:02,929 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:02,929 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:02,929 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:02,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,931 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,944 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,944 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,944 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,944 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:02,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:02,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 585 msec 2023-07-11 20:14:02,953 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 20:14:02,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-11 20:14:02,972 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-11 20:14:03,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions e2b58c8b19e6c2759635d0da272b397a, cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:03,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e2b58c8b19e6c2759635d0da272b397a, cffafb0cb776893bc22a34fc94c709c5], force=true 2023-07-11 20:14:03,013 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e2b58c8b19e6c2759635d0da272b397a, cffafb0cb776893bc22a34fc94c709c5], force=true 2023-07-11 20:14:03,013 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e2b58c8b19e6c2759635d0da272b397a, cffafb0cb776893bc22a34fc94c709c5], force=true 2023-07-11 20:14:03,013 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e2b58c8b19e6c2759635d0da272b397a, cffafb0cb776893bc22a34fc94c709c5], force=true 2023-07-11 20:14:03,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:03,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, UNASSIGN}] 2023-07-11 20:14:03,051 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, UNASSIGN 2023-07-11 20:14:03,051 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, UNASSIGN 2023-07-11 20:14:03,052 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e2b58c8b19e6c2759635d0da272b397a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:03,053 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106443052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106443052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106443052"}]},"ts":"1689106443052"} 2023-07-11 20:14:03,053 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=cffafb0cb776893bc22a34fc94c709c5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:03,053 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106443053"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106443053"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106443053"}]},"ts":"1689106443053"} 2023-07-11 20:14:03,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure e2b58c8b19e6c2759635d0da272b397a, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:03,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure cffafb0cb776893bc22a34fc94c709c5, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:14:03,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:03,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:03,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:03,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e2b58c8b19e6c2759635d0da272b397a, disabling compactions & flushes 2023-07-11 20:14:03,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cffafb0cb776893bc22a34fc94c709c5, disabling compactions & flushes 2023-07-11 20:14:03,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:03,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:03,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. after waiting 0 ms 2023-07-11 20:14:03,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:03,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e2b58c8b19e6c2759635d0da272b397a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 20:14:03,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:03,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:03,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. after waiting 0 ms 2023-07-11 20:14:03,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:03,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cffafb0cb776893bc22a34fc94c709c5 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-11 20:14:03,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/.tmp/cf/f93f940eac434c148030c2722f99290e 2023-07-11 20:14:03,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/.tmp/cf/f2a0dae55a044e2880da15822a2543bd 2023-07-11 20:14:03,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/.tmp/cf/f93f940eac434c148030c2722f99290e as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf/f93f940eac434c148030c2722f99290e 2023-07-11 20:14:03,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/.tmp/cf/f2a0dae55a044e2880da15822a2543bd as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf/f2a0dae55a044e2880da15822a2543bd 2023-07-11 20:14:03,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf/f93f940eac434c148030c2722f99290e, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 20:14:03,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for cffafb0cb776893bc22a34fc94c709c5 in 91ms, sequenceid=5, compaction requested=false 2023-07-11 20:14:03,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:03,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf/f2a0dae55a044e2880da15822a2543bd, entries=1, sequenceid=5, filesize=4.7 K 2023-07-11 20:14:03,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for e2b58c8b19e6c2759635d0da272b397a in 109ms, sequenceid=5, compaction requested=false 2023-07-11 20:14:03,354 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:14:03,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-11 20:14:03,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:03,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:03,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5. 2023-07-11 20:14:03,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a. 2023-07-11 20:14:03,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cffafb0cb776893bc22a34fc94c709c5: 2023-07-11 20:14:03,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e2b58c8b19e6c2759635d0da272b397a: 2023-07-11 20:14:03,359 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:03,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=cffafb0cb776893bc22a34fc94c709c5, regionState=CLOSED 2023-07-11 20:14:03,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106443359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106443359"}]},"ts":"1689106443359"} 2023-07-11 20:14:03,364 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=e2b58c8b19e6c2759635d0da272b397a, regionState=CLOSED 2023-07-11 20:14:03,364 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689106443364"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106443364"}]},"ts":"1689106443364"} 2023-07-11 20:14:03,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:03,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-11 20:14:03,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure cffafb0cb776893bc22a34fc94c709c5, server=jenkins-hbase4.apache.org,46707,1689106362013 in 306 msec 2023-07-11 20:14:03,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-11 20:14:03,374 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure e2b58c8b19e6c2759635d0da272b397a, server=jenkins-hbase4.apache.org,43979,1689106362092 in 311 msec 2023-07-11 20:14:03,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=cffafb0cb776893bc22a34fc94c709c5, UNASSIGN in 324 msec 2023-07-11 20:14:03,376 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-11 20:14:03,377 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e2b58c8b19e6c2759635d0da272b397a, UNASSIGN in 331 msec 2023-07-11 20:14:03,491 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-11 20:14:03,494 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442360.e2b58c8b19e6c2759635d0da272b397a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:03,494 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689106442360.cffafb0cb776893bc22a34fc94c709c5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:03,494 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:03,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, ASSIGN}] 2023-07-11 20:14:03,569 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, ASSIGN 2023-07-11 20:14:03,569 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:14:03,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:03,720 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-11 20:14:03,722 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=df16c59a989c9c396acdc9068b7eb8a8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:03,722 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106443722"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106443722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106443722"}]},"ts":"1689106443722"} 2023-07-11 20:14:03,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure df16c59a989c9c396acdc9068b7eb8a8, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:03,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:03,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => df16c59a989c9c396acdc9068b7eb8a8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.', STARTKEY => '', ENDKEY => ''} 2023-07-11 20:14:03,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. service=AccessControlService 2023-07-11 20:14:03,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:03,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:03,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:03,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:03,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:03,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/.regioninfo 2023-07-11 20:14:03,947 INFO [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:03,948 DEBUG [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf 2023-07-11 20:14:03,948 DEBUG [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf 2023-07-11 20:14:03,949 INFO [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region df16c59a989c9c396acdc9068b7eb8a8 columnFamilyName cf 2023-07-11 20:14:04,000 DEBUG [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f2a0dae55a044e2880da15822a2543bd.e2b58c8b19e6c2759635d0da272b397a->hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf/f2a0dae55a044e2880da15822a2543bd-top 2023-07-11 20:14:04,049 DEBUG [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] regionserver.HStore(539): loaded hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f93f940eac434c148030c2722f99290e.cffafb0cb776893bc22a34fc94c709c5->hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf/f93f940eac434c148030c2722f99290e-top 2023-07-11 20:14:04,050 INFO [StoreOpener-df16c59a989c9c396acdc9068b7eb8a8-1] regionserver.HStore(310): Store=df16c59a989c9c396acdc9068b7eb8a8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:04,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:04,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:04,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:04,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened df16c59a989c9c396acdc9068b7eb8a8; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63214054, jitterRate=-0.05803719162940979}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:04,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for df16c59a989c9c396acdc9068b7eb8a8: 2023-07-11 20:14:04,085 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0004_000001 (auth:SIMPLE) 2023-07-11 20:14:04,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8., pid=77, masterSystemTime=1689106443876 2023-07-11 20:14:04,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.,because compaction is disabled. 2023-07-11 20:14:04,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:04,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:04,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=df16c59a989c9c396acdc9068b7eb8a8, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106444107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106444107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106444107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106444107"}]},"ts":"1689106444107"} 2023-07-11 20:14:04,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-11 20:14:04,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure df16c59a989c9c396acdc9068b7eb8a8, server=jenkins-hbase4.apache.org,43979,1689106362092 in 386 msec 2023-07-11 20:14:04,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-11 20:14:04,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, ASSIGN in 550 msec 2023-07-11 20:14:04,121 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[e2b58c8b19e6c2759635d0da272b397a, cffafb0cb776893bc22a34fc94c709c5], force=true in 1.1160 sec 2023-07-11 20:14:04,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-11 20:14:04,126 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-11 20:14:04,127 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 20:14:04,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106444127 (current time:1689106444127). 2023-07-11 20:14:04,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:04,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x047b2a69 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:04,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d51fb46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:04,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:04,189 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:04,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x047b2a69 to 127.0.0.1:53621 2023-07-11 20:14:04,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:04,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x5df693bb to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:04,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@83c20e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:04,203 DEBUG [hconnection-0x62ea9293-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:04,207 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:04,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:04,220 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:04,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5df693bb to 127.0.0.1:53621 2023-07-11 20:14:04,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:04,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-11 20:14:04,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:04,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 20:14:04,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 20:14:04,228 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 20:14:04,229 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689107044229 2023-07-11 20:14:04,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-11 20:14:04,229 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,234 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:04,235 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:04,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 20:14:04,236 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-11 20:14:04,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 11 msec 2023-07-11 20:14:04,240 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 20:14:04,245 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689107044245 2023-07-11 20:14:04,290 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,291 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-11 20:14:04,291 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:04,296 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-11 20:14:04,296 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-11 20:14:04,326 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,327 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,328 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:04,328 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:04,328 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,329 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:04,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:04,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:04,329 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,329 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:04,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:04,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,330 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 20:14:04,331 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 20:14:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-11 20:14:04,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 20:14:04,332 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:04,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-11 20:14:04,336 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:04,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 20:14:04,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:04,337 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:04,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,340 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 20:14:04,340 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 20:14:04,341 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 20:14:04,341 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 20:14:04,341 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:04,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 20:14:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 20:14:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 20:14:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-11 20:14:04,350 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-11 20:14:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-11 20:14:04,352 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-11 20:14:04,353 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:04,354 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,355 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:04,355 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:04,356 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,356 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:04,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:04,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:04,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-11 20:14:04,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ed6f3e[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:04,360 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-11 20:14:04,360 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,362 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,362 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 20:14:04,365 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,365 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 20:14:04,365 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 20:14:04,365 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:04,366 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,367 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:04,367 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:04,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,367 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-11 20:14:04,367 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 20:14:04,367 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:04,367 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:04,367 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. started... 2023-07-11 20:14:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 20:14:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:04,369 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 20:14:04,371 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,371 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:04,371 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for df16c59a989c9c396acdc9068b7eb8a8: 2023-07-11 20:14:04,372 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,372 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:04,372 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f2a0dae55a044e2880da15822a2543bd.e2b58c8b19e6c2759635d0da272b397a->hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf/f2a0dae55a044e2880da15822a2543bd-top, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f93f940eac434c148030c2722f99290e.cffafb0cb776893bc22a34fc94c709c5->hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf/f93f940eac434c148030c2722f99290e-top] hfiles 2023-07-11 20:14:04,372 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f2a0dae55a044e2880da15822a2543bd.e2b58c8b19e6c2759635d0da272b397a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,372 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 20:14:04,372 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:04,372 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 20:14:04,377 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f93f940eac434c148030c2722f99290e.cffafb0cb776893bc22a34fc94c709c5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,437 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. completed. 2023-07-11 20:14:04,437 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,437 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-11 20:14:04,438 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:04,448 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-11 20:14:04,448 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,449 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:04,449 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-11 20:14:04,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:04,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:04,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:14:04,454 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-11 20:14:04,454 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-11 20:14:04,454 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:04,454 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:04,454 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,454 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:04,464 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,464 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:04,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:04,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:04,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:04,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:04,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:04,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,470 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:04,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:04,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,473 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:04,474 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,474 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:04,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,477 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:04,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,478 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,478 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,483 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:04,483 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:04,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:04,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:04,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:04,483 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:04,483 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:04,483 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:04,483 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,483 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:04,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:04,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:04,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:04,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:04,538 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:04,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 20:14:04,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:04,539 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:04,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,752 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-11 20:14:04,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,752 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689106444229Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106444484 (+255 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106444484Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106444498 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689106444603 (+105 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689106444752 (+149 ms) 2023-07-11 20:14:04,756 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-11 20:14:04,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 522 msec 2023-07-11 20:14:04,840 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:04,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-11 20:14:04,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:04,841 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841 2023-07-11 20:14:04,842 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:14:04,871 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:14:04,871 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-236510946_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:04,872 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-11 20:14:04,885 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:05,016 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,017 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,017 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,018 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,019 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,019 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,019 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-3560332987038301258.jar 2023-07-11 20:14:05,115 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,116 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,116 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,117 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,118 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:14:05,119 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:14:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:14:05,120 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:14:05,121 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:14:05,122 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:14:05,122 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:14:05,123 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:14:05,123 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:14:05,124 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:14:05,125 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:05,125 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:05,126 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:05,126 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:05,126 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:05,127 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:05,128 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:05,576 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:14:06,650 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:14:06,653 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-11 20:14:06,655 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-11 20:14:07,163 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:07,163 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:07,865 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:13,919 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:16,271 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:20,284 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:21,379 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:14:21,385 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:14:21,400 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,401 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:14:21,401 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:14:21,401 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,403 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 20:14:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 20:14:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-11 20:14:21,404 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106444841/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-11 20:14:21,416 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 20:14:21,423 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106461423"}]},"ts":"1689106461423"} 2023-07-11 20:14:21,424 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-11 20:14:21,427 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-11 20:14:21,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, UNASSIGN}] 2023-07-11 20:14:21,431 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, UNASSIGN 2023-07-11 20:14:21,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=df16c59a989c9c396acdc9068b7eb8a8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:21,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106461432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106461432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106461432"}]},"ts":"1689106461432"} 2023-07-11 20:14:21,434 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure df16c59a989c9c396acdc9068b7eb8a8, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:21,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 20:14:21,586 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:21,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing df16c59a989c9c396acdc9068b7eb8a8, disabling compactions & flushes 2023-07-11 20:14:21,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:21,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:21,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. after waiting 0 ms 2023-07-11 20:14:21,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:21,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-11 20:14:21,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:21,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8. 2023-07-11 20:14:21,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for df16c59a989c9c396acdc9068b7eb8a8: 2023-07-11 20:14:21,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:21,618 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=df16c59a989c9c396acdc9068b7eb8a8, regionState=CLOSED 2023-07-11 20:14:21,618 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689106461618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106461618"}]},"ts":"1689106461618"} 2023-07-11 20:14:21,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-11 20:14:21,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure df16c59a989c9c396acdc9068b7eb8a8, server=jenkins-hbase4.apache.org,43979,1689106362092 in 186 msec 2023-07-11 20:14:21,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-11 20:14:21,624 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=df16c59a989c9c396acdc9068b7eb8a8, UNASSIGN in 193 msec 2023-07-11 20:14:21,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106461628"}]},"ts":"1689106461628"} 2023-07-11 20:14:21,639 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-11 20:14:21,641 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-11 20:14:21,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 225 msec 2023-07-11 20:14:21,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-11 20:14:21,728 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-11 20:14:21,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,734 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,735 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,737 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,741 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,741 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,741 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,741 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:21,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:21,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:21,743 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:21,743 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,745 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:21,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 20:14:21,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:21,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:21,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:21,748 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:21,748 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:21,749 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/recovered.edits] 2023-07-11 20:14:21,750 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/recovered.edits] 2023-07-11 20:14:21,752 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:21,759 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf/f93f940eac434c148030c2722f99290e to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/cf/f93f940eac434c148030c2722f99290e 2023-07-11 20:14:21,763 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/recovered.edits/8.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5/recovered.edits/8.seqid 2023-07-11 20:14:21,764 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/recovered.edits] 2023-07-11 20:14:21,764 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:21,767 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f2a0dae55a044e2880da15822a2543bd.e2b58c8b19e6c2759635d0da272b397a to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f2a0dae55a044e2880da15822a2543bd.e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:21,768 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f93f940eac434c148030c2722f99290e.cffafb0cb776893bc22a34fc94c709c5 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/cf/f93f940eac434c148030c2722f99290e.cffafb0cb776893bc22a34fc94c709c5 2023-07-11 20:14:21,771 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf/f2a0dae55a044e2880da15822a2543bd to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/cf/f2a0dae55a044e2880da15822a2543bd 2023-07-11 20:14:21,772 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/recovered.edits/12.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8/recovered.edits/12.seqid 2023-07-11 20:14:21,773 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/df16c59a989c9c396acdc9068b7eb8a8 2023-07-11 20:14:21,774 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/recovered.edits/8.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a/recovered.edits/8.seqid 2023-07-11 20:14:21,775 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e2b58c8b19e6c2759635d0da272b397a 2023-07-11 20:14:21,775 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-11 20:14:21,779 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,785 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-11 20:14:21,788 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-11 20:14:21,789 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,789 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-11 20:14:21,789 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106461789"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:21,792 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-11 20:14:21,792 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => df16c59a989c9c396acdc9068b7eb8a8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689106442361.df16c59a989c9c396acdc9068b7eb8a8.', STARTKEY => '', ENDKEY => ''}] 2023-07-11 20:14:21,792 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-11 20:14:21,792 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106461792"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:21,794 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-11 20:14:21,796 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:21,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 67 msec 2023-07-11 20:14:21,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-11 20:14:21,848 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-11 20:14:21,848 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:21,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:21,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:21,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 20:14:21,865 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106461865"}]},"ts":"1689106461865"} 2023-07-11 20:14:21,868 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-11 20:14:21,869 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-11 20:14:21,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, UNASSIGN}] 2023-07-11 20:14:21,879 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, UNASSIGN 2023-07-11 20:14:21,879 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, UNASSIGN 2023-07-11 20:14:21,879 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f4338ea461f39021eac0571a1fa86e4d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:21,879 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f7c8b81c982dab57e08f2f20ae4db760, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:21,880 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106461879"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106461879"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106461879"}]},"ts":"1689106461879"} 2023-07-11 20:14:21,880 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106461879"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106461879"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106461879"}]},"ts":"1689106461879"} 2023-07-11 20:14:21,883 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure f4338ea461f39021eac0571a1fa86e4d, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:21,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure f7c8b81c982dab57e08f2f20ae4db760, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:14:21,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 20:14:22,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:22,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f4338ea461f39021eac0571a1fa86e4d, disabling compactions & flushes 2023-07-11 20:14:22,036 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:22,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:22,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. after waiting 0 ms 2023-07-11 20:14:22,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:22,038 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:22,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7c8b81c982dab57e08f2f20ae4db760, disabling compactions & flushes 2023-07-11 20:14:22,039 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:22,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:22,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. after waiting 0 ms 2023-07-11 20:14:22,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:22,077 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:22,081 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:22,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d. 2023-07-11 20:14:22,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f4338ea461f39021eac0571a1fa86e4d: 2023-07-11 20:14:22,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:22,092 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f4338ea461f39021eac0571a1fa86e4d, regionState=CLOSED 2023-07-11 20:14:22,092 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106462092"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106462092"}]},"ts":"1689106462092"} 2023-07-11 20:14:22,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:22,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:22,097 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760. 2023-07-11 20:14:22,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7c8b81c982dab57e08f2f20ae4db760: 2023-07-11 20:14:22,100 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:22,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-11 20:14:22,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure f4338ea461f39021eac0571a1fa86e4d, server=jenkins-hbase4.apache.org,43979,1689106362092 in 212 msec 2023-07-11 20:14:22,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f4338ea461f39021eac0571a1fa86e4d, UNASSIGN in 231 msec 2023-07-11 20:14:22,103 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f7c8b81c982dab57e08f2f20ae4db760, regionState=CLOSED 2023-07-11 20:14:22,103 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689106462102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106462102"}]},"ts":"1689106462102"} 2023-07-11 20:14:22,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-11 20:14:22,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure f7c8b81c982dab57e08f2f20ae4db760, server=jenkins-hbase4.apache.org,40513,1689106361915 in 221 msec 2023-07-11 20:14:22,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-11 20:14:22,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f7c8b81c982dab57e08f2f20ae4db760, UNASSIGN in 238 msec 2023-07-11 20:14:22,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106462113"}]},"ts":"1689106462113"} 2023-07-11 20:14:22,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-11 20:14:22,122 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-11 20:14:22,125 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 275 msec 2023-07-11 20:14:22,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-11 20:14:22,161 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-11 20:14:22,162 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,166 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,168 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,168 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,174 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:22,174 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:22,178 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/recovered.edits] 2023-07-11 20:14:22,178 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/recovered.edits] 2023-07-11 20:14:22,178 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,178 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,178 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,179 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:22,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:22,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:22,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-11 20:14:22,190 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,190 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,190 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,190 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,190 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,190 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,190 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf/8c5387d68b8844ec8588ef1bc35a9c04 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/cf/8c5387d68b8844ec8588ef1bc35a9c04 2023-07-11 20:14:22,191 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,191 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,192 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf/234a7923daac46adb6cf54b1bae02e45 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/cf/234a7923daac46adb6cf54b1bae02e45 2023-07-11 20:14:22,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 20:14:22,212 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760/recovered.edits/9.seqid 2023-07-11 20:14:22,212 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d/recovered.edits/9.seqid 2023-07-11 20:14:22,213 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f7c8b81c982dab57e08f2f20ae4db760 2023-07-11 20:14:22,213 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f4338ea461f39021eac0571a1fa86e4d 2023-07-11 20:14:22,213 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-11 20:14:22,214 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-11 20:14:22,215 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-11 20:14:22,220 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230711c3717eeb7f0147949e49f28603138fc8 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230711c3717eeb7f0147949e49f28603138fc8 2023-07-11 20:14:22,222 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071183946b6f169243a68e9e8a43c8dcf25b to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071183946b6f169243a68e9e8a43c8dcf25b 2023-07-11 20:14:22,224 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-11 20:14:22,233 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,236 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-11 20:14:22,239 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-11 20:14:22,248 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,248 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-11 20:14:22,248 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106462248"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:22,249 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106462248"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:22,251 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:22,251 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f7c8b81c982dab57e08f2f20ae4db760, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689106440226.f7c8b81c982dab57e08f2f20ae4db760.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f4338ea461f39021eac0571a1fa86e4d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689106440226.f4338ea461f39021eac0571a1fa86e4d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:22,251 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-11 20:14:22,251 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106462251"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:22,258 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-11 20:14:22,261 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 99 msec 2023-07-11 20:14:22,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-11 20:14:22,293 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-11 20:14:22,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 20:14:22,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-11 20:14:22,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-11 20:14:22,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-11 20:14:22,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-11 20:14:22,374 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 746) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:44266 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:38678 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:38686 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:37769 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1817737787_1 at /127.0.0.1:60478 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4217 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1817737787_1 at /127.0.0.1:46402 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:45722 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=587 (was 413) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=1910 (was 2132) 2023-07-11 20:14:22,375 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-11 20:14:22,428 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=587, ProcessCount=184, AvailableMemoryMB=1894 2023-07-11 20:14:22,428 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-11 20:14:22,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 20:14:22,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:22,435 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:22,436 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-11 20:14:22,437 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:22,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:22,440 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,440 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,440 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 empty. 2023-07-11 20:14:22,441 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e empty. 2023-07-11 20:14:22,444 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,445 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,445 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 20:14:22,483 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:22,487 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b92d1aff3da582a4843ba51972fc3e7, NAME => 'testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:22,492 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 705b6de91c2f720cee8e58d9f27ccf7e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:22,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:22,577 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:22,578 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 1b92d1aff3da582a4843ba51972fc3e7, disabling compactions & flushes 2023-07-11 20:14:22,578 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,578 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,578 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. after waiting 0 ms 2023-07-11 20:14:22,578 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,578 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,578 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 1b92d1aff3da582a4843ba51972fc3e7: 2023-07-11 20:14:22,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:22,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 705b6de91c2f720cee8e58d9f27ccf7e, disabling compactions & flushes 2023-07-11 20:14:22,580 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. after waiting 0 ms 2023-07-11 20:14:22,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,580 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,580 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 705b6de91c2f720cee8e58d9f27ccf7e: 2023-07-11 20:14:22,591 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:22,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106462592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106462592"}]},"ts":"1689106462592"} 2023-07-11 20:14:22,592 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106462592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106462592"}]},"ts":"1689106462592"} 2023-07-11 20:14:22,596 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:22,598 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:22,598 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106462598"}]},"ts":"1689106462598"} 2023-07-11 20:14:22,603 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-11 20:14:22,606 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:22,607 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:22,608 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:22,608 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:22,608 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:22,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, ASSIGN}] 2023-07-11 20:14:22,618 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, ASSIGN 2023-07-11 20:14:22,619 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, ASSIGN 2023-07-11 20:14:22,627 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43979,1689106362092; forceNewPlan=false, retain=false 2023-07-11 20:14:22,628 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40513,1689106361915; forceNewPlan=false, retain=false 2023-07-11 20:14:22,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:22,778 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:22,781 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=705b6de91c2f720cee8e58d9f27ccf7e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:22,781 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106462781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106462781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106462781"}]},"ts":"1689106462781"} 2023-07-11 20:14:22,782 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1b92d1aff3da582a4843ba51972fc3e7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:22,782 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106462782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106462782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106462782"}]},"ts":"1689106462782"} 2023-07-11 20:14:22,786 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 705b6de91c2f720cee8e58d9f27ccf7e, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:22,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 1b92d1aff3da582a4843ba51972fc3e7, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:14:22,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b92d1aff3da582a4843ba51972fc3e7, NAME => 'testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:14:22,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. service=AccessControlService 2023-07-11 20:14:22,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:22,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:22,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 705b6de91c2f720cee8e58d9f27ccf7e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:14:22,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. service=AccessControlService 2023-07-11 20:14:22,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:22,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:22,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,952 INFO [StoreOpener-1b92d1aff3da582a4843ba51972fc3e7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,953 INFO [StoreOpener-705b6de91c2f720cee8e58d9f27ccf7e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,954 DEBUG [StoreOpener-1b92d1aff3da582a4843ba51972fc3e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf 2023-07-11 20:14:22,954 DEBUG [StoreOpener-1b92d1aff3da582a4843ba51972fc3e7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf 2023-07-11 20:14:22,954 DEBUG [StoreOpener-705b6de91c2f720cee8e58d9f27ccf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf 2023-07-11 20:14:22,954 DEBUG [StoreOpener-705b6de91c2f720cee8e58d9f27ccf7e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf 2023-07-11 20:14:22,955 INFO [StoreOpener-1b92d1aff3da582a4843ba51972fc3e7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b92d1aff3da582a4843ba51972fc3e7 columnFamilyName cf 2023-07-11 20:14:22,955 INFO [StoreOpener-705b6de91c2f720cee8e58d9f27ccf7e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 705b6de91c2f720cee8e58d9f27ccf7e columnFamilyName cf 2023-07-11 20:14:22,956 INFO [StoreOpener-1b92d1aff3da582a4843ba51972fc3e7-1] regionserver.HStore(310): Store=1b92d1aff3da582a4843ba51972fc3e7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:22,956 INFO [StoreOpener-705b6de91c2f720cee8e58d9f27ccf7e-1] regionserver.HStore(310): Store=705b6de91c2f720cee8e58d9f27ccf7e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:22,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:22,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:22,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:22,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 705b6de91c2f720cee8e58d9f27ccf7e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64526126, jitterRate=-0.03848579525947571}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:22,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 705b6de91c2f720cee8e58d9f27ccf7e: 2023-07-11 20:14:22,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:22,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e., pid=93, masterSystemTime=1689106462945 2023-07-11 20:14:22,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b92d1aff3da582a4843ba51972fc3e7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65383685, jitterRate=-0.025707170367240906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:22,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b92d1aff3da582a4843ba51972fc3e7: 2023-07-11 20:14:22,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7., pid=94, masterSystemTime=1689106462945 2023-07-11 20:14:22,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:22,973 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=705b6de91c2f720cee8e58d9f27ccf7e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:22,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106462973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106462973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106462973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106462973"}]},"ts":"1689106462973"} 2023-07-11 20:14:22,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:22,977 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=1b92d1aff3da582a4843ba51972fc3e7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:22,977 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106462977"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106462977"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106462977"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106462977"}]},"ts":"1689106462977"} 2023-07-11 20:14:22,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-11 20:14:22,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 705b6de91c2f720cee8e58d9f27ccf7e, server=jenkins-hbase4.apache.org,43979,1689106362092 in 190 msec 2023-07-11 20:14:22,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-11 20:14:22,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 1b92d1aff3da582a4843ba51972fc3e7, server=jenkins-hbase4.apache.org,40513,1689106361915 in 191 msec 2023-07-11 20:14:22,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, ASSIGN in 371 msec 2023-07-11 20:14:22,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-11 20:14:22,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, ASSIGN in 373 msec 2023-07-11 20:14:22,987 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:22,987 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106462987"}]},"ts":"1689106462987"} 2023-07-11 20:14:22,988 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-11 20:14:22,991 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:22,992 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-11 20:14:22,993 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:14:22,995 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,995 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,995 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,995 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:22,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:22,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:22,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:22,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:23,002 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 569 msec 2023-07-11 20:14:23,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-11 20:14:23,043 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-11 20:14:23,049 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:23,049 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:23,051 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:23,089 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:23,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106463089 (current time:1689106463089). 2023-07-11 20:14:23,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:23,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x592a86d0 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:23,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cedb7cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:23,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:23,109 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:23,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x592a86d0 to 127.0.0.1:53621 2023-07-11 20:14:23,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:23,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x349475db to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:23,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3905799f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:23,131 DEBUG [hconnection-0x1877faa4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:23,136 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:23,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:23,144 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:23,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x349475db to 127.0.0.1:53621 2023-07-11 20:14:23,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:23,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:14:23,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:23,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:23,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:23,154 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:23,163 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689107063163 2023-07-11 20:14:23,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:23,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:23,166 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:23,166 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:23,168 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:23,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:23,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 17 msec 2023-07-11 20:14:23,184 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:23,184 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689107063184 2023-07-11 20:14:23,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,198 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-11 20:14:23,198 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:23,200 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 20:14:23,200 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:14:23,252 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,253 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:23,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:23,257 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:23,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:23,257 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:23,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:23,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:23,258 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,258 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,258 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,258 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,258 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:23,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-11 20:14:23,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,260 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:23,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,260 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,261 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:23,261 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:23,261 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:23,261 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:23,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,261 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:23,266 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:23,264 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:23,264 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:23,271 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:23,270 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:23,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:23,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:23,271 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:23,273 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:23,274 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:23,274 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,275 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:23,276 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:23,276 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,277 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:23,277 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,277 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:23,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:23,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5aa298[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:23,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:23,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:23,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:23,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a5aa298[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:23,283 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:14:23,283 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:23,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:23,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:23,286 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:23,286 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:23,287 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. started... 2023-07-11 20:14:23,287 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:23,289 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:23,289 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 705b6de91c2f720cee8e58d9f27ccf7e: 2023-07-11 20:14:23,289 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:23,289 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,289 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. started... 2023-07-11 20:14:23,289 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:23,289 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:23,290 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b92d1aff3da582a4843ba51972fc3e7: 2023-07-11 20:14:23,290 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,290 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:23,290 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:23,290 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:23,290 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:23,290 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:23,334 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. completed. 2023-07-11 20:14:23,334 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:23,334 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:23,334 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:23,334 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,334 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:23,334 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:23,336 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:23,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:23,337 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:23,337 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:23,337 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:23,337 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. completed. 2023-07-11 20:14:23,339 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:23,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:23,339 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:23,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:23,342 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:23,342 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:23,342 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:23,345 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:23,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:23,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:14:23,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:14:23,354 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 20:14:23,354 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:23,354 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:23,354 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,354 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:23,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,357 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:23,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:23,358 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,361 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,361 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,364 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:23,364 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,364 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,367 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:23,367 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:23,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:23,367 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:23,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:23,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:23,368 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:23,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,368 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:23,368 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,368 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:23,368 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:23,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:23,368 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:23,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:23,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:23,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:14:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:23,368 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,370 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,370 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,370 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:23,370 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:23,370 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:23,371 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:23,371 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,371 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 20:14:23,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,396 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,472 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:23,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:23,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:23,474 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:23,513 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 20:14:23,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,514 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689106463163Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689106463395 (+232 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689106463395Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689106463395Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689106463399 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689106463410 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689106463513 (+103 ms) 2023-07-11 20:14:23,522 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:23,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 357 msec 2023-07-11 20:14:23,774 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:23,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:23,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:23,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40513] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:23,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43979] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:23,782 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:23,782 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:23,783 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:23,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:23,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106463792 (current time:1689106463792). 2023-07-11 20:14:23,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:23,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x3d4b2423 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:23,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a4e4bf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:23,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:23,858 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:23,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d4b2423 to 127.0.0.1:53621 2023-07-11 20:14:23,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:23,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x611be7f9 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:23,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@595bdc5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:23,912 DEBUG [hconnection-0x6dec5768-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:23,913 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36036, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:23,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:23,919 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43336, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x611be7f9 to 127.0.0.1:53621 2023-07-11 20:14:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-11 20:14:23,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:23,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:23,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:23,925 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:23,926 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689107063926 2023-07-11 20:14:23,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-11 20:14:23,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:23,931 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:23,931 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:23,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:23,934 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-11 20:14:23,936 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-11 20:14:23,937 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:23,937 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689107063937 2023-07-11 20:14:23,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,962 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-11 20:14:23,962 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:23,964 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-11 20:14:23,964 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-11 20:14:23,965 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:23,965 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,010 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:24,010 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:24,010 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:24,010 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:24,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:24,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:24,011 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,011 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,012 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,012 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:24,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-11 20:14:24,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,013 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-11 20:14:24,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:24,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-11 20:14:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:24,013 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-11 20:14:24,019 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-11 20:14:24,031 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:24,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:24,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:24,032 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:24,048 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,048 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,048 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:24,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:24,056 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,057 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,057 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,057 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,057 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:24,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:24,057 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,057 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:24,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:24,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:24,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:24,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12a7c854[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:24,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:24,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-11 20:14:24,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12a7c854[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:24,065 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-11 20:14:24,065 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,057 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:24,085 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,085 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:24,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,086 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:24,086 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-11 20:14:24,086 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:24,086 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:24,090 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:24,090 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:24,090 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:24,094 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:24,110 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:24,111 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:24,111 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:24,111 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. started... 2023-07-11 20:14:24,111 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:24,111 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1b92d1aff3da582a4843ba51972fc3e7 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-11 20:14:24,111 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,112 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,112 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:24,111 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. started... 2023-07-11 20:14:24,112 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 705b6de91c2f720cee8e58d9f27ccf7e 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-11 20:14:24,195 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230711cdc7473d3c9542949cc1ece17ae6962b to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711cdc7473d3c9542949cc1ece17ae6962b 2023-07-11 20:14:24,198 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071190a4df2170544c9eb674d5d441733d44 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071190a4df2170544c9eb674d5d441733d44 2023-07-11 20:14:24,227 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/.tmp/cf/4abed054fcc340a48991a91a5949df32 2023-07-11 20:14:24,232 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:24,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:24,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:24,234 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/.tmp/cf/cd2668dccceb49edbf4e0dacc2ed331d 2023-07-11 20:14:24,234 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:24,236 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/.tmp/cf/4abed054fcc340a48991a91a5949df32 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf/4abed054fcc340a48991a91a5949df32 2023-07-11 20:14:24,240 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/.tmp/cf/cd2668dccceb49edbf4e0dacc2ed331d as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf/cd2668dccceb49edbf4e0dacc2ed331d 2023-07-11 20:14:24,242 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf/4abed054fcc340a48991a91a5949df32, entries=2, sequenceid=6, filesize=5.2 K 2023-07-11 20:14:24,244 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 1b92d1aff3da582a4843ba51972fc3e7 in 133ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:24,244 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-11 20:14:24,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1b92d1aff3da582a4843ba51972fc3e7: 2023-07-11 20:14:24,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:24,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf/4abed054fcc340a48991a91a5949df32] hfiles 2023-07-11 20:14:24,245 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf/4abed054fcc340a48991a91a5949df32 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,246 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf/cd2668dccceb49edbf4e0dacc2ed331d, entries=48, sequenceid=6, filesize=13.2 K 2023-07-11 20:14:24,248 INFO [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 705b6de91c2f720cee8e58d9f27ccf7e in 136ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:24,249 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 705b6de91c2f720cee8e58d9f27ccf7e: 2023-07-11 20:14:24,250 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,251 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:24,251 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf/cd2668dccceb49edbf4e0dacc2ed331d] hfiles 2023-07-11 20:14:24,252 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf/cd2668dccceb49edbf4e0dacc2ed331d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,263 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. completed. 2023-07-11 20:14:24,263 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:24,263 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:24,263 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:24,263 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,263 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:24,263 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:24,265 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:24,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:24,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:24,265 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:24,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:24,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:24,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,272 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. completed. 2023-07-11 20:14:24,272 DEBUG [rs(jenkins-hbase4.apache.org,43979,1689106362092)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:24,272 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:24,272 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:24,272 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,272 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-11 20:14:24,272 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:24,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:24,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,274 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,274 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-11 20:14:24,274 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:24,274 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-11 20:14:24,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:14:24,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-11 20:14:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:24,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:24,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:24,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:24,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43979,1689106362092': 2023-07-11 20:14:24,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-11 20:14:24,282 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-11 20:14:24,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:24,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:24,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,282 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:24,283 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,283 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,284 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:24,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:24,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:24,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:24,285 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:24,286 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:24,288 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,288 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,289 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:24,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,293 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:24,293 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:24,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:24,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,293 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:24,294 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:24,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:14:24,294 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:24,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:24,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:24,295 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,296 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:24,296 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:24,296 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,296 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071190a4df2170544c9eb674d5d441733d44, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711cdc7473d3c9542949cc1ece17ae6962b] mob files 2023-07-11 20:14:24,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071190a4df2170544c9eb674d5d441733d44 2023-07-11 20:14:24,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711cdc7473d3c9542949cc1ece17ae6962b 2023-07-11 20:14:24,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-11 20:14:24,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,367 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689106463926Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689106464304 (+378 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689106464304Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689106464304Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689106464307 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689106464320 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689106464366 (+46 ms) 2023-07-11 20:14:24,370 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-11 20:14:24,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 442 msec 2023-07-11 20:14:24,534 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-11 20:14:24,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:24,536 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536 2023-07-11 20:14:24,536 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:14:24,567 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:14:24,567 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1532047471_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,567 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-11 20:14:24,576 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:24,618 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,618 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,620 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,620 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,620 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,621 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,621 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,703 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-1478543400141779927.jar 2023-07-11 20:14:24,704 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,704 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,704 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,705 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,705 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,706 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:24,706 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:14:24,707 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:14:24,707 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:14:24,707 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:14:24,708 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:14:24,708 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:14:24,709 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:14:24,709 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:14:24,709 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:14:24,710 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:14:24,710 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:24,710 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:24,711 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:24,712 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:24,712 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:26,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0005_000001 (auth:SIMPLE) 2023-07-11 20:14:26,552 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:14:26,555 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-11 20:14:26,661 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:26,661 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:27,237 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:14:27,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0006_000001 (auth:SIMPLE) 2023-07-11 20:14:32,838 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0006_000001 (auth:SIMPLE) 2023-07-11 20:14:35,790 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:14:35,791 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:14:35,805 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:35,806 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:14:35,806 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:14:35,806 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 20:14:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 20:14:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:35,807 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-11 20:14:35,808 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106464536/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-11 20:14:35,816 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-11 20:14:35,817 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-11 20:14:35,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:35,824 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106475824"}]},"ts":"1689106475824"} 2023-07-11 20:14:35,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:35,827 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-11 20:14:35,833 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-11 20:14:35,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, UNASSIGN}] 2023-07-11 20:14:35,836 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, UNASSIGN 2023-07-11 20:14:35,836 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, UNASSIGN 2023-07-11 20:14:35,837 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1b92d1aff3da582a4843ba51972fc3e7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:35,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=705b6de91c2f720cee8e58d9f27ccf7e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:35,837 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106475837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106475837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106475837"}]},"ts":"1689106475837"} 2023-07-11 20:14:35,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106475837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106475837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106475837"}]},"ts":"1689106475837"} 2023-07-11 20:14:35,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 1b92d1aff3da582a4843ba51972fc3e7, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:14:35,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 705b6de91c2f720cee8e58d9f27ccf7e, server=jenkins-hbase4.apache.org,43979,1689106362092}] 2023-07-11 20:14:35,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:35,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:35,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b92d1aff3da582a4843ba51972fc3e7, disabling compactions & flushes 2023-07-11 20:14:35,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:35,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:35,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. after waiting 0 ms 2023-07-11 20:14:35,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:35,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:35,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 705b6de91c2f720cee8e58d9f27ccf7e, disabling compactions & flushes 2023-07-11 20:14:35,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:35,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:35,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. after waiting 0 ms 2023-07-11 20:14:35,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:36,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:36,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:36,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:36,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:36,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e. 2023-07-11 20:14:36,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 705b6de91c2f720cee8e58d9f27ccf7e: 2023-07-11 20:14:36,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7. 2023-07-11 20:14:36,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b92d1aff3da582a4843ba51972fc3e7: 2023-07-11 20:14:36,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:36,019 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=1b92d1aff3da582a4843ba51972fc3e7, regionState=CLOSED 2023-07-11 20:14:36,019 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106476019"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106476019"}]},"ts":"1689106476019"} 2023-07-11 20:14:36,019 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:36,020 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=705b6de91c2f720cee8e58d9f27ccf7e, regionState=CLOSED 2023-07-11 20:14:36,020 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689106476020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106476020"}]},"ts":"1689106476020"} 2023-07-11 20:14:36,025 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-11 20:14:36,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 1b92d1aff3da582a4843ba51972fc3e7, server=jenkins-hbase4.apache.org,40513,1689106361915 in 182 msec 2023-07-11 20:14:36,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-11 20:14:36,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 705b6de91c2f720cee8e58d9f27ccf7e, server=jenkins-hbase4.apache.org,43979,1689106362092 in 183 msec 2023-07-11 20:14:36,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1b92d1aff3da582a4843ba51972fc3e7, UNASSIGN in 193 msec 2023-07-11 20:14:36,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-11 20:14:36,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=705b6de91c2f720cee8e58d9f27ccf7e, UNASSIGN in 193 msec 2023-07-11 20:14:36,030 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106476030"}]},"ts":"1689106476030"} 2023-07-11 20:14:36,031 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-11 20:14:36,033 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-11 20:14:36,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 217 msec 2023-07-11 20:14:36,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-11 20:14:36,127 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-11 20:14:36,129 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,133 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,134 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,136 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,139 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,139 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,139 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,140 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:36,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:36,140 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:36,141 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-11 20:14:36,142 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,142 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,142 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,142 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,143 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,143 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,142 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,143 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 20:14:36,149 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:36,149 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:36,152 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/recovered.edits] 2023-07-11 20:14:36,156 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/recovered.edits] 2023-07-11 20:14:36,163 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf/cd2668dccceb49edbf4e0dacc2ed331d to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/cf/cd2668dccceb49edbf4e0dacc2ed331d 2023-07-11 20:14:36,173 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e/recovered.edits/9.seqid 2023-07-11 20:14:36,173 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf/4abed054fcc340a48991a91a5949df32 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/cf/4abed054fcc340a48991a91a5949df32 2023-07-11 20:14:36,174 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/705b6de91c2f720cee8e58d9f27ccf7e 2023-07-11 20:14:36,179 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7/recovered.edits/9.seqid 2023-07-11 20:14:36,180 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testEmptyExportFileSystemState/1b92d1aff3da582a4843ba51972fc3e7 2023-07-11 20:14:36,180 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-11 20:14:36,181 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-11 20:14:36,182 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-11 20:14:36,187 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071190a4df2170544c9eb674d5d441733d44 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071190a4df2170544c9eb674d5d441733d44 2023-07-11 20:14:36,189 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711cdc7473d3c9542949cc1ece17ae6962b to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230711cdc7473d3c9542949cc1ece17ae6962b 2023-07-11 20:14:36,191 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-11 20:14:36,194 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,198 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-11 20:14:36,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-11 20:14:36,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,203 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-11 20:14:36,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106476203"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:36,203 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106476203"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:36,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:36,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1b92d1aff3da582a4843ba51972fc3e7, NAME => 'testtb-testEmptyExportFileSystemState,,1689106462430.1b92d1aff3da582a4843ba51972fc3e7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 705b6de91c2f720cee8e58d9f27ccf7e, NAME => 'testtb-testEmptyExportFileSystemState,1,1689106462430.705b6de91c2f720cee8e58d9f27ccf7e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:36,221 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-11 20:14:36,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106476221"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:36,231 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-11 20:14:36,236 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-11 20:14:36,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 107 msec 2023-07-11 20:14:36,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-11 20:14:36,245 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-11 20:14:36,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-11 20:14:36,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:36,265 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-11 20:14:36,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-11 20:14:36,309 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 762) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:41387 from appattempt_1689106369861_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:38445 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:43490 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:44793 from appattempt_1689106369861_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2058100246_1 at /127.0.0.1:43458 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2058100246_1 at /127.0.0.1:50670 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5019 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:51066 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:50686 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=684 (was 587) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=843 (was 1894) 2023-07-11 20:14:36,309 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-11 20:14:36,343 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=684, ProcessCount=181, AvailableMemoryMB=842 2023-07-11 20:14:36,343 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-11 20:14:36,345 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-11 20:14:36,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:36,350 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-11 20:14:36,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-11 20:14:36,350 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-11 20:14:36,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:36,353 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,353 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,354 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b empty. 2023-07-11 20:14:36,354 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 empty. 2023-07-11 20:14:36,355 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,355 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,355 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 20:14:36,405 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-11 20:14:36,407 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d954cde9767d29047420a0ecba9b97b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:36,407 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => bc38a1953561cf520de41d3000d6ba43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp 2023-07-11 20:14:36,436 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:36,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0d954cde9767d29047420a0ecba9b97b, disabling compactions & flushes 2023-07-11 20:14:36,437 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. after waiting 0 ms 2023-07-11 20:14:36,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,437 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,437 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0d954cde9767d29047420a0ecba9b97b: 2023-07-11 20:14:36,439 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:36,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing bc38a1953561cf520de41d3000d6ba43, disabling compactions & flushes 2023-07-11 20:14:36,440 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. after waiting 0 ms 2023-07-11 20:14:36,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,440 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for bc38a1953561cf520de41d3000d6ba43: 2023-07-11 20:14:36,443 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-11 20:14:36,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106476444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106476444"}]},"ts":"1689106476444"} 2023-07-11 20:14:36,444 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106476444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106476444"}]},"ts":"1689106476444"} 2023-07-11 20:14:36,448 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-11 20:14:36,449 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-11 20:14:36,449 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106476449"}]},"ts":"1689106476449"} 2023-07-11 20:14:36,451 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-11 20:14:36,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:36,454 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-11 20:14:36,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-11 20:14:36,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-11 20:14:36,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-11 20:14:36,456 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-11 20:14:36,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, ASSIGN}] 2023-07-11 20:14:36,459 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, ASSIGN 2023-07-11 20:14:36,459 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, ASSIGN 2023-07-11 20:14:36,460 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46707,1689106362013; forceNewPlan=false, retain=false 2023-07-11 20:14:36,460 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40513,1689106361915; forceNewPlan=false, retain=false 2023-07-11 20:14:36,610 INFO [jenkins-hbase4:36627] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-11 20:14:36,613 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0d954cde9767d29047420a0ecba9b97b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:36,613 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bc38a1953561cf520de41d3000d6ba43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:36,614 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106476613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106476613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106476613"}]},"ts":"1689106476613"} 2023-07-11 20:14:36,614 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106476613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106476613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106476613"}]},"ts":"1689106476613"} 2023-07-11 20:14:36,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 0d954cde9767d29047420a0ecba9b97b, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:14:36,616 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure bc38a1953561cf520de41d3000d6ba43, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:14:36,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:36,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,775 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bc38a1953561cf520de41d3000d6ba43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.', STARTKEY => '', ENDKEY => '1'} 2023-07-11 20:14:36,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d954cde9767d29047420a0ecba9b97b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.', STARTKEY => '1', ENDKEY => ''} 2023-07-11 20:14:36,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. service=AccessControlService 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. service=AccessControlService 2023-07-11 20:14:36,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,776 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,777 INFO [StoreOpener-0d954cde9767d29047420a0ecba9b97b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,777 INFO [StoreOpener-bc38a1953561cf520de41d3000d6ba43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,779 DEBUG [StoreOpener-bc38a1953561cf520de41d3000d6ba43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf 2023-07-11 20:14:36,779 DEBUG [StoreOpener-bc38a1953561cf520de41d3000d6ba43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf 2023-07-11 20:14:36,780 INFO [StoreOpener-bc38a1953561cf520de41d3000d6ba43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bc38a1953561cf520de41d3000d6ba43 columnFamilyName cf 2023-07-11 20:14:36,780 DEBUG [StoreOpener-0d954cde9767d29047420a0ecba9b97b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf 2023-07-11 20:14:36,780 DEBUG [StoreOpener-0d954cde9767d29047420a0ecba9b97b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf 2023-07-11 20:14:36,781 INFO [StoreOpener-0d954cde9767d29047420a0ecba9b97b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d954cde9767d29047420a0ecba9b97b columnFamilyName cf 2023-07-11 20:14:36,782 INFO [StoreOpener-bc38a1953561cf520de41d3000d6ba43-1] regionserver.HStore(310): Store=bc38a1953561cf520de41d3000d6ba43/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:36,782 INFO [StoreOpener-0d954cde9767d29047420a0ecba9b97b-1] regionserver.HStore(310): Store=0d954cde9767d29047420a0ecba9b97b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-11 20:14:36,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:36,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:36,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:36,788 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bc38a1953561cf520de41d3000d6ba43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64119594, jitterRate=-0.04454359412193298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:36,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bc38a1953561cf520de41d3000d6ba43: 2023-07-11 20:14:36,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43., pid=109, masterSystemTime=1689106476769 2023-07-11 20:14:36,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,792 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,792 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=bc38a1953561cf520de41d3000d6ba43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:36,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106476792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106476792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106476792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106476792"}]},"ts":"1689106476792"} 2023-07-11 20:14:36,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-11 20:14:36,803 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure bc38a1953561cf520de41d3000d6ba43, server=jenkins-hbase4.apache.org,40513,1689106361915 in 186 msec 2023-07-11 20:14:36,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-11 20:14:36,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, ASSIGN in 347 msec 2023-07-11 20:14:36,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0d954cde9767d29047420a0ecba9b97b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66820573, jitterRate=-0.004295870661735535}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-11 20:14:36,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0d954cde9767d29047420a0ecba9b97b: 2023-07-11 20:14:36,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b., pid=108, masterSystemTime=1689106476769 2023-07-11 20:14:36,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,808 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:36,808 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0d954cde9767d29047420a0ecba9b97b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:36,808 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106476808"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689106476808"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689106476808"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689106476808"}]},"ts":"1689106476808"} 2023-07-11 20:14:36,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-11 20:14:36,812 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 0d954cde9767d29047420a0ecba9b97b, server=jenkins-hbase4.apache.org,46707,1689106362013 in 195 msec 2023-07-11 20:14:36,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-11 20:14:36,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, ASSIGN in 356 msec 2023-07-11 20:14:36,814 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-11 20:14:36,814 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106476814"}]},"ts":"1689106476814"} 2023-07-11 20:14:36,815 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-11 20:14:36,819 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-11 20:14:36,819 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-11 20:14:36,821 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 20:14:36,823 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,823 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,823 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,823 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:36,824 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:36,824 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:36,825 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:36,825 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-11 20:14:36,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 480 msec 2023-07-11 20:14:36,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-11 20:14:36,955 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-11 20:14:36,958 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:36,958 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:36,960 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:36,978 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106476978 (current time:1689106476978). 2023-07-11 20:14:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x19662072 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:36,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70bb8fd0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:36,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:37,003 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38442, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:37,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19662072 to 127.0.0.1:53621 2023-07-11 20:14:37,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:37,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x5a662de6 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:37,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72abf368, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:37,015 DEBUG [hconnection-0x5e4227e2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:37,019 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38456, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:37,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:37,026 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a662de6 to 127.0.0.1:53621 2023-07-11 20:14:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 20:14:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:37,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:37,031 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:37,032 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689107077032 2023-07-11 20:14:37,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:37,032 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,034 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:37,034 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:37,034 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:37,035 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:37,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-11 20:14:37,037 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:37,038 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689107077038 2023-07-11 20:14:37,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,047 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:37,048 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:37,049 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 20:14:37,049 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 20:14:37,050 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,050 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,051 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:37,051 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:37,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:37,051 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:37,051 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:37,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,052 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,052 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,052 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,052 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 20:14:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:37,053 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:37,053 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:37,053 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,053 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:37,053 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:37,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:37,056 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:37,057 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:37,057 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:37,057 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,064 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:37,064 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:37,064 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:37,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:37,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:37,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6af5aa5[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:37,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:37,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:37,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:37,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6af5aa5[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:37,070 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 20:14:37,071 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:37,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,072 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:37,072 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:37,073 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,073 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:37,073 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:37,074 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:37,073 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. started... 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. started... 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc38a1953561cf520de41d3000d6ba43: 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:37,074 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:37,074 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:37,074 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:37,074 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:37,078 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d954cde9767d29047420a0ecba9b97b: 2023-07-11 20:14:37,078 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,078 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:37,078 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-11 20:14:37,095 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. completed. 2023-07-11 20:14:37,095 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:37,095 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:37,095 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:37,095 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,095 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:37,095 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:37,095 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. completed. 2023-07-11 20:14:37,095 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:37,095 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:37,096 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:37,096 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,096 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:37,096 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:37,098 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:37,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:37,098 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:37,101 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:37,101 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,101 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:37,101 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:37,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46707,1689106362013': 2023-07-11 20:14:37,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 20:14:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:37,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:14:37,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 20:14:37,113 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 20:14:37,113 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:37,113 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:37,113 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,113 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:37,115 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:37,116 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:37,116 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:37,116 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:37,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,116 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:37,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:37,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:37,117 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,118 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:37,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,119 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:37,120 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,120 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,123 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:37,123 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:37,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:37,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,123 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:37,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,123 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:37,123 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:37,123 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,124 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:37,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:14:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:37,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:37,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:37,126 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:37,127 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,127 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:37,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:37,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-11 20:14:37,134 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:37,135 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:37,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,335 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:37,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:37,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:37,338 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:37,639 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:37,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:37,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:37,640 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-11 20:14:37,671 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 20:14:37,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,672 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:37,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689106477032Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689106477135 (+103 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106477135Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106477136 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106477139 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689106477191 (+52 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689106477671 (+480 ms) 2023-07-11 20:14:37,675 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:37,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 642 msec 2023-07-11 20:14:38,140 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:38,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:38,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:38,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:38,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46707] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-11 20:14:38,157 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,157 DEBUG [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:38,157 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-11 20:14:38,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:38,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689106478167 (current time:1689106478167). 2023-07-11 20:14:38,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-11 20:14:38,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x0ebb162a to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:38,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41095d28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:38,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:38,195 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38468, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:38,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ebb162a to 127.0.0.1:53621 2023-07-11 20:14:38,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:38,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(139): Connect 0x3a7fd8d7 to 127.0.0.1:53621 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-11 20:14:38,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ca383f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-11 20:14:38,215 DEBUG [hconnection-0x67c87355-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:38,218 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:38,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-11 20:14:38,228 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35672, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-11 20:14:38,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a7fd8d7 to 127.0.0.1:53621 2023-07-11 20:14:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:14:38,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-11 20:14:38,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-11 20:14:38,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:38,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:38,242 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:38,243 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689107078243 2023-07-11 20:14:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-11 20:14:38,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,246 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-11 20:14:38,246 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-11 20:14:38,248 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-11 20:14:38,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:38,250 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-11 20:14:38,252 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:38,252 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689107078252 2023-07-11 20:14:38,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,275 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:38,275 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:38,277 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-11 20:14:38,277 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-11 20:14:38,278 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,278 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,280 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:38,280 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:38,280 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:38,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:38,280 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:38,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:38,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,281 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,282 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-11 20:14:38,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:38,283 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-11 20:14:38,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-11 20:14:38,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,284 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:38,284 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:38,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,285 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-11 20:14:38,287 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:38,287 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-11 20:14:38,287 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:38,289 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-11 20:14:38,289 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:38,287 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:38,289 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:38,289 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-11 20:14:38,289 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:38,290 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43979,1689106362092' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-11 20:14:38,291 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,292 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:38,292 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,292 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:38,292 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,292 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:38,292 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,293 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:38,293 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,293 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-11 20:14:38,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:38,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:38,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40513,1689106361915' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:38,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6151d1[Count = 1] remaining members to acquire global barrier 2023-07-11 20:14:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:38,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:38,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:38,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,46707,1689106362013' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-11 20:14:38,301 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5c6151d1[Count = 0] remaining members to acquire global barrier 2023-07-11 20:14:38,301 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-11 20:14:38,301 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,310 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,310 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:38,311 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-11 20:14:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:38,311 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43979,1689106362092' in zk 2023-07-11 20:14:38,311 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,311 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-11 20:14:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:38,313 DEBUG [member: 'jenkins-hbase4.apache.org,43979,1689106362092' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:38,318 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:38,319 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:38,319 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:38,322 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-11 20:14:38,323 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-11 20:14:38,323 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. started... 2023-07-11 20:14:38,323 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bc38a1953561cf520de41d3000d6ba43 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-11 20:14:38,324 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:38,324 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. started... 2023-07-11 20:14:38,324 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0d954cde9767d29047420a0ecba9b97b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-11 20:14:38,346 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:38,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:38,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:38,347 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-11 20:14:38,365 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230711805b3f039e8a448c8997ac545ac30afc to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711805b3f039e8a448c8997ac545ac30afc 2023-07-11 20:14:38,366 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071100301c55c5524b379ada60804fae9abc to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071100301c55c5524b379ada60804fae9abc 2023-07-11 20:14:38,394 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/.tmp/cf/50acec7a1050431ab0c30756784df302 2023-07-11 20:14:38,402 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/.tmp/cf/50acec7a1050431ab0c30756784df302 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf/50acec7a1050431ab0c30756784df302 2023-07-11 20:14:38,402 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/.tmp/cf/3a25fd3ccaa941d1826ec1b5e18a124f 2023-07-11 20:14:38,407 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf/50acec7a1050431ab0c30756784df302, entries=3, sequenceid=6, filesize=5.4 K 2023-07-11 20:14:38,408 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/.tmp/cf/3a25fd3ccaa941d1826ec1b5e18a124f as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf/3a25fd3ccaa941d1826ec1b5e18a124f 2023-07-11 20:14:38,408 INFO [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for bc38a1953561cf520de41d3000d6ba43 in 85ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:38,408 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-11 20:14:38,409 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bc38a1953561cf520de41d3000d6ba43: 2023-07-11 20:14:38,409 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,409 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:38,409 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf/50acec7a1050431ab0c30756784df302] hfiles 2023-07-11 20:14:38,409 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf/50acec7a1050431ab0c30756784df302 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,413 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf/3a25fd3ccaa941d1826ec1b5e18a124f, entries=47, sequenceid=6, filesize=13.4 K 2023-07-11 20:14:38,414 INFO [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0d954cde9767d29047420a0ecba9b97b in 90ms, sequenceid=6, compaction requested=false 2023-07-11 20:14:38,418 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0d954cde9767d29047420a0ecba9b97b: 2023-07-11 20:14:38,418 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,418 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-11 20:14:38,418 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf/3a25fd3ccaa941d1826ec1b5e18a124f] hfiles 2023-07-11 20:14:38,418 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf/3a25fd3ccaa941d1826ec1b5e18a124f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,429 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. completed. 2023-07-11 20:14:38,429 DEBUG [rs(jenkins-hbase4.apache.org,40513,1689106361915)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:38,429 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40513,1689106361915' in zk 2023-07-11 20:14:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:38,431 DEBUG [member: 'jenkins-hbase4.apache.org,40513,1689106361915' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:38,432 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:38,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40513,1689106361915': 2023-07-11 20:14:38,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40513,1689106361915' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-11 20:14:38,443 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. completed. 2023-07-11 20:14:38,443 DEBUG [rs(jenkins-hbase4.apache.org,46707,1689106362013)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:38,443 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-11 20:14:38,443 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-11 20:14:38,443 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,443 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-11 20:14:38,443 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,46707,1689106362013' in zk 2023-07-11 20:14:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-11 20:14:38,445 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:38,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,46707,1689106362013' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-11 20:14:38,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:38,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:38,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:38,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,46707,1689106362013': 2023-07-11 20:14:38,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,46707,1689106362013' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-11 20:14:38,460 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-11 20:14:38,460 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-11 20:14:38,460 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-11 20:14:38,460 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,460 INFO [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-11 20:14:38,463 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,463 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:38,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:38,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,463 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:38,463 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:38,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-11 20:14:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:38,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,466 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-11 20:14:38,467 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,467 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-11 20:14:38,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,469 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,470 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,471 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:38,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:38,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:38,478 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,478 DEBUG [(jenkins-hbase4.apache.org,36627,1689106360268)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-11 20:14:38,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-11 20:14:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-11 20:14:38,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-11 20:14:38,478 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,481 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:38,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:38,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711805b3f039e8a448c8997ac545ac30afc, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071100301c55c5524b379ada60804fae9abc] mob files 2023-07-11 20:14:38,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711805b3f039e8a448c8997ac545ac30afc 2023-07-11 20:14:38,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071100301c55c5524b379ada60804fae9abc 2023-07-11 20:14:38,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-11 20:14:38,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-11 20:14:38,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,547 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:38,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:38,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-11 20:14:38,549 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-11 20:14:38,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-11 20:14:38,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,556 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689106478243Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689106478497 (+254 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689106478497Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689106478497Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689106478506 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689106478515 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689106478555 (+40 ms) 2023-07-11 20:14:38,559 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-11 20:14:38,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 313 msec 2023-07-11 20:14:38,849 DEBUG [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-11 20:14:38,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-11 20:14:38,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-11 20:14:38,851 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851 2023-07-11 20:14:38,851 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:44579, tgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851, rawTgtDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851, srcFsUri=hdfs://localhost:44579, srcDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:14:38,883 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63 2023-07-11 20:14:38,884 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-981117475_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:38,884 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:44579, inputRoot=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63, snapshotDir=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-11 20:14:38,929 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:39,015 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,015 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,016 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,016 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,016 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,016 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,017 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,099 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/hadoop-1565788580222196083.jar 2023-07-11 20:14:39,100 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,100 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,101 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,101 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,101 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,102 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-11 20:14:39,103 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-11 20:14:39,103 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-11 20:14:39,104 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-11 20:14:39,104 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-11 20:14:39,105 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-11 20:14:39,106 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-11 20:14:39,106 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-11 20:14:39,106 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-11 20:14:39,107 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-11 20:14:39,107 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-11 20:14:39,107 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:39,108 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:39,108 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:39,108 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:39,109 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-11 20:14:39,109 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:39,109 DEBUG [Listener at jenkins-hbase4.apache.org/34985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-11 20:14:40,023 WARN [Listener at jenkins-hbase4.apache.org/34985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-11 20:14:40,026 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-11 20:14:40,028 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-11 20:14:40,464 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0006_000001 (auth:SIMPLE) 2023-07-11 20:14:40,465 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:40,465 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-11 20:14:40,537 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0007_000001 (auth:SIMPLE) 2023-07-11 20:14:41,642 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:14:46,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0007_000001 (auth:SIMPLE) 2023-07-11 20:14:48,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689106369861_0007_000001 (auth:SIMPLE) 2023-07-11 20:14:54,240 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-11 20:14:54,240 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-11 20:14:54,255 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,255 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-11 20:14:54,256 INFO [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-11 20:14:54,256 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,256 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 20:14:54,256 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 20:14:54,256 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-929596972_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-11 20:14:54,257 DEBUG [Listener at jenkins-hbase4.apache.org/34985] snapshot.TestExportSnapshot(367): hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/export-test/export-1689106478851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-11 20:14:54,263 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 20:14:54,268 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106494268"}]},"ts":"1689106494268"} 2023-07-11 20:14:54,269 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-11 20:14:54,271 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-11 20:14:54,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, UNASSIGN}] 2023-07-11 20:14:54,273 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, UNASSIGN 2023-07-11 20:14:54,273 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, UNASSIGN 2023-07-11 20:14:54,274 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bc38a1953561cf520de41d3000d6ba43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:14:54,274 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0d954cde9767d29047420a0ecba9b97b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:14:54,274 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106494274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106494274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106494274"}]},"ts":"1689106494274"} 2023-07-11 20:14:54,274 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106494274"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689106494274"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689106494274"}]},"ts":"1689106494274"} 2023-07-11 20:14:54,275 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure bc38a1953561cf520de41d3000d6ba43, server=jenkins-hbase4.apache.org,40513,1689106361915}] 2023-07-11 20:14:54,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 0d954cde9767d29047420a0ecba9b97b, server=jenkins-hbase4.apache.org,46707,1689106362013}] 2023-07-11 20:14:54,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 20:14:54,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:54,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bc38a1953561cf520de41d3000d6ba43, disabling compactions & flushes 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0d954cde9767d29047420a0ecba9b97b, disabling compactions & flushes 2023-07-11 20:14:54,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:54,428 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. after waiting 0 ms 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. after waiting 0 ms 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:54,428 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:54,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:14:54,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:54,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43. 2023-07-11 20:14:54,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bc38a1953561cf520de41d3000d6ba43: 2023-07-11 20:14:54,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:14:54,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b. 2023-07-11 20:14:54,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0d954cde9767d29047420a0ecba9b97b: 2023-07-11 20:14:54,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:54,483 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=bc38a1953561cf520de41d3000d6ba43, regionState=CLOSED 2023-07-11 20:14:54,483 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106494483"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106494483"}]},"ts":"1689106494483"} 2023-07-11 20:14:54,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:54,485 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0d954cde9767d29047420a0ecba9b97b, regionState=CLOSED 2023-07-11 20:14:54,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689106494485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689106494485"}]},"ts":"1689106494485"} 2023-07-11 20:14:54,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-11 20:14:54,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure bc38a1953561cf520de41d3000d6ba43, server=jenkins-hbase4.apache.org,40513,1689106361915 in 210 msec 2023-07-11 20:14:54,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=bc38a1953561cf520de41d3000d6ba43, UNASSIGN in 221 msec 2023-07-11 20:14:54,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-11 20:14:54,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 0d954cde9767d29047420a0ecba9b97b, server=jenkins-hbase4.apache.org,46707,1689106362013 in 217 msec 2023-07-11 20:14:54,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-11 20:14:54,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0d954cde9767d29047420a0ecba9b97b, UNASSIGN in 223 msec 2023-07-11 20:14:54,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689106494497"}]},"ts":"1689106494497"} 2023-07-11 20:14:54,499 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-11 20:14:54,500 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-11 20:14:54,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 237 msec 2023-07-11 20:14:54,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-11 20:14:54,570 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-11 20:14:54,571 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,574 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,575 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,576 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43979] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,579 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:54,579 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:54,581 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,581 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,581 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,581 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,581 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/recovered.edits] 2023-07-11 20:14:54,582 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf, FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/recovered.edits] 2023-07-11 20:14:54,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:54,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:54,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:54,582 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:54,583 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-11 20:14:54,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 20:14:54,587 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf/50acec7a1050431ab0c30756784df302 to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/cf/50acec7a1050431ab0c30756784df302 2023-07-11 20:14:54,588 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf/3a25fd3ccaa941d1826ec1b5e18a124f to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/cf/3a25fd3ccaa941d1826ec1b5e18a124f 2023-07-11 20:14:54,591 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b/recovered.edits/9.seqid 2023-07-11 20:14:54,591 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/recovered.edits/9.seqid to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43/recovered.edits/9.seqid 2023-07-11 20:14:54,592 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0d954cde9767d29047420a0ecba9b97b 2023-07-11 20:14:54,592 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/bc38a1953561cf520de41d3000d6ba43 2023-07-11 20:14:54,592 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-11 20:14:54,592 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-11 20:14:54,593 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-11 20:14:54,600 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711805b3f039e8a448c8997ac545ac30afc to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230711805b3f039e8a448c8997ac545ac30afc 2023-07-11 20:14:54,601 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071100301c55c5524b379ada60804fae9abc to hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023071100301c55c5524b379ada60804fae9abc 2023-07-11 20:14:54,601 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-11 20:14:54,605 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,607 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-11 20:14:54,611 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-11 20:14:54,612 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,612 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-11 20:14:54,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106494612"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:54,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689106494612"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:54,618 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-11 20:14:54,618 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bc38a1953561cf520de41d3000d6ba43, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689106476345.bc38a1953561cf520de41d3000d6ba43.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0d954cde9767d29047420a0ecba9b97b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689106476345.0d954cde9767d29047420a0ecba9b97b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-11 20:14:54,618 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-11 20:14:54,619 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689106494618"}]},"ts":"9223372036854775807"} 2023-07-11 20:14:54,620 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-11 20:14:54,622 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,625 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 51 msec 2023-07-11 20:14:54,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-11 20:14:54,686 INFO [Listener at jenkins-hbase4.apache.org/34985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-11 20:14:54,693 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 20:14:54,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,697 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-11 20:14:54,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36627] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-11 20:14:54,727 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 763) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_554584894_1 at /127.0.0.1:42330 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:42354 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:39702 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5659 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_554584894_1 at /127.0.0.1:45642 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-929596972_17 at /127.0.0.1:45656 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:42779 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7a631db2-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=900 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=717 (was 684) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 181), AvailableMemoryMB=1260 (was 842) - AvailableMemoryMB LEAK? - 2023-07-11 20:14:54,727 WARN [Listener at jenkins-hbase4.apache.org/34985] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-11 20:14:54,727 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-11 20:14:54,758 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:14:54,870 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689106369861_0007_01_000001 is : 143 2023-07-11 20:15:00,067 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-11 20:15:08,886 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:15:23,034 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 20:15:23,035 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:15:23,159 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-11 20:15:23,168 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-11 20:15:23,169 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 20:15:23,178 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-11 20:15:23,282 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-11 20:15:23,282 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-11 20:15:23,282 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-11 20:15:23,282 INFO [Listener at jenkins-hbase4.apache.org/34985] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-11 20:15:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/34985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0789e732 to 127.0.0.1:53621 2023-07-11 20:15:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/34985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/34985] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-11 20:15:23,282 DEBUG [Listener at jenkins-hbase4.apache.org/34985] util.JVMClusterUtil(257): Found active master hash=145868615, stopped=false 2023-07-11 20:15:23,283 DEBUG [Listener at jenkins-hbase4.apache.org/34985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,283 DEBUG [Listener at jenkins-hbase4.apache.org/34985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-11 20:15:23,283 INFO [Listener at jenkins-hbase4.apache.org/34985] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:15:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-11 20:15:23,285 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:15:23,285 INFO [Listener at jenkins-hbase4.apache.org/34985] procedure2.ProcedureExecutor(629): Stopping 2023-07-11 20:15:23,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:23,286 DEBUG [Listener at jenkins-hbase4.apache.org/34985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c495bfa to 127.0.0.1:53621 2023-07-11 20:15:23,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:23,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:23,286 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-11 20:15:23,286 DEBUG [Listener at jenkins-hbase4.apache.org/34985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,286 INFO [Listener at jenkins-hbase4.apache.org/34985] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40513,1689106361915' ***** 2023-07-11 20:15:23,286 DEBUG [Listener at jenkins-hbase4.apache.org/34985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,286 INFO [Listener at jenkins-hbase4.apache.org/34985] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:15:23,287 INFO [Listener at jenkins-hbase4.apache.org/34985] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,46707,1689106362013' ***** 2023-07-11 20:15:23,287 DEBUG [Listener at jenkins-hbase4.apache.org/34985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,287 INFO [RS:0;jenkins-hbase4:40513] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:15:23,287 INFO [Listener at jenkins-hbase4.apache.org/34985] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:15:23,287 INFO [Listener at jenkins-hbase4.apache.org/34985] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43979,1689106362092' ***** 2023-07-11 20:15:23,287 INFO [RS:0;jenkins-hbase4:40513] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:15:23,287 DEBUG [Listener at jenkins-hbase4.apache.org/34985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,287 INFO [RS:0;jenkins-hbase4:40513] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:15:23,287 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:15:23,287 INFO [RS:1;jenkins-hbase4:46707] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:15:23,287 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:15:23,287 INFO [RS:1;jenkins-hbase4:46707] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:15:23,287 DEBUG [RS:0;jenkins-hbase4:40513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45f53bc5 to 127.0.0.1:53621 2023-07-11 20:15:23,287 INFO [Listener at jenkins-hbase4.apache.org/34985] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-11 20:15:23,287 DEBUG [RS:0;jenkins-hbase4:40513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,287 INFO [RS:1;jenkins-hbase4:46707] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:15:23,288 INFO [RS:2;jenkins-hbase4:43979] regionserver.HeapMemoryManager(220): Stopping 2023-07-11 20:15:23,287 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:15:23,290 INFO [RS:2;jenkins-hbase4:43979] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-11 20:15:23,290 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-11 20:15:23,290 INFO [RS:2;jenkins-hbase4:43979] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-11 20:15:23,290 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40513,1689106361915; all regions closed. 2023-07-11 20:15:23,291 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(3305): Received CLOSE for 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:15:23,291 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:15:23,291 DEBUG [RS:2;jenkins-hbase4:43979] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72a5cfaa to 127.0.0.1:53621 2023-07-11 20:15:23,291 DEBUG [RS:2;jenkins-hbase4:43979] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2bf19f7bc882b70da83d97bf0eebb506, disabling compactions & flushes 2023-07-11 20:15:23,292 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-11 20:15:23,292 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1478): Online Regions={2bf19f7bc882b70da83d97bf0eebb506=hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506.} 2023-07-11 20:15:23,292 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(3305): Received CLOSE for a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:15:23,292 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:15:23,292 DEBUG [RS:1;jenkins-hbase4:46707] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ac7b63 to 127.0.0.1:53621 2023-07-11 20:15:23,292 DEBUG [RS:1;jenkins-hbase4:46707] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,293 DEBUG [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1504): Waiting on 2bf19f7bc882b70da83d97bf0eebb506 2023-07-11 20:15:23,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:15:23,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:15:23,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. after waiting 0 ms 2023-07-11 20:15:23,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:15:23,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2bf19f7bc882b70da83d97bf0eebb506 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-11 20:15:23,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2b8f46affab8347acb03d8216f633c3, disabling compactions & flushes 2023-07-11 20:15:23,294 INFO [RS:1;jenkins-hbase4:46707] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:15:23,294 INFO [RS:1;jenkins-hbase4:46707] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:15:23,294 INFO [RS:1;jenkins-hbase4:46707] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:15:23,294 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-11 20:15:23,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:15:23,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:15:23,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. after waiting 0 ms 2023-07-11 20:15:23,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:15:23,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a2b8f46affab8347acb03d8216f633c3 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-11 20:15:23,295 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-11 20:15:23,295 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, a2b8f46affab8347acb03d8216f633c3=hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3.} 2023-07-11 20:15:23,295 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1504): Waiting on 1588230740, a2b8f46affab8347acb03d8216f633c3 2023-07-11 20:15:23,296 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:23,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-11 20:15:23,302 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-11 20:15:23,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-11 20:15:23,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-11 20:15:23,302 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-11 20:15:23,303 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-11 20:15:23,330 DEBUG [RS:0;jenkins-hbase4:40513] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs 2023-07-11 20:15:23,331 INFO [RS:0;jenkins-hbase4:40513] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40513%2C1689106361915:(num 1689106364251) 2023-07-11 20:15:23,331 DEBUG [RS:0;jenkins-hbase4:40513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,331 INFO [RS:0;jenkins-hbase4:40513] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:23,331 INFO [RS:0;jenkins-hbase4:40513] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 20:15:23,331 INFO [RS:0;jenkins-hbase4:40513] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:15:23,331 INFO [RS:0;jenkins-hbase4:40513] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:15:23,331 INFO [RS:0;jenkins-hbase4:40513] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:15:23,332 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:23,346 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:23,352 INFO [RS:0;jenkins-hbase4:40513] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40513 2023-07-11 20:15:23,371 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40513,1689106361915 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:23,376 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:23,383 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40513,1689106361915] 2023-07-11 20:15:23,391 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40513,1689106361915; numProcessing=1 2023-07-11 20:15:23,444 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40513,1689106361915 already deleted, retry=false 2023-07-11 20:15:23,444 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40513,1689106361915 expired; onlineServers=2 2023-07-11 20:15:23,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/.tmp/info/922fe73a007c442da149cbcec695674e 2023-07-11 20:15:23,445 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/.tmp/info/8523ed0e5f964d73aa1571c49dacaade 2023-07-11 20:15:23,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/.tmp/l/5593f0e973a64801ba20665eb57663de 2023-07-11 20:15:23,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8523ed0e5f964d73aa1571c49dacaade 2023-07-11 20:15:23,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/.tmp/info/922fe73a007c442da149cbcec695674e as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/info/922fe73a007c442da149cbcec695674e 2023-07-11 20:15:23,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5593f0e973a64801ba20665eb57663de 2023-07-11 20:15:23,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/.tmp/l/5593f0e973a64801ba20665eb57663de as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/l/5593f0e973a64801ba20665eb57663de 2023-07-11 20:15:23,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/info/922fe73a007c442da149cbcec695674e, entries=2, sequenceid=6, filesize=4.8 K 2023-07-11 20:15:23,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5593f0e973a64801ba20665eb57663de 2023-07-11 20:15:23,457 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/l/5593f0e973a64801ba20665eb57663de, entries=7, sequenceid=18, filesize=5.2 K 2023-07-11 20:15:23,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for a2b8f46affab8347acb03d8216f633c3 in 164ms, sequenceid=6, compaction requested=false 2023-07-11 20:15:23,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 2bf19f7bc882b70da83d97bf0eebb506 in 165ms, sequenceid=18, compaction requested=false 2023-07-11 20:15:23,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/.tmp/rep_barrier/ebec1c1d0aa243cf997fe6d2162e1c14 2023-07-11 20:15:23,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/namespace/a2b8f46affab8347acb03d8216f633c3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-11 20:15:23,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:15:23,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/acl/2bf19f7bc882b70da83d97bf0eebb506/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-11 20:15:23,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2b8f46affab8347acb03d8216f633c3: 2023-07-11 20:15:23,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689106364840.a2b8f46affab8347acb03d8216f633c3. 2023-07-11 20:15:23,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,490 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:15:23,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2bf19f7bc882b70da83d97bf0eebb506: 2023-07-11 20:15:23,491 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689106365699.2bf19f7bc882b70da83d97bf0eebb506. 2023-07-11 20:15:23,492 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebec1c1d0aa243cf997fe6d2162e1c14 2023-07-11 20:15:23,493 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43979,1689106362092; all regions closed. 2023-07-11 20:15:23,495 DEBUG [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-11 20:15:23,499 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/WALs/jenkins-hbase4.apache.org,43979,1689106362092/jenkins-hbase4.apache.org%2C43979%2C1689106362092.1689106364251 not finished, retry = 0 2023-07-11 20:15:23,509 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/.tmp/table/55105c25364b43319b40f26ed2a1ded3 2023-07-11 20:15:23,513 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55105c25364b43319b40f26ed2a1ded3 2023-07-11 20:15:23,514 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/.tmp/info/8523ed0e5f964d73aa1571c49dacaade as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/info/8523ed0e5f964d73aa1571c49dacaade 2023-07-11 20:15:23,520 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8523ed0e5f964d73aa1571c49dacaade 2023-07-11 20:15:23,521 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/info/8523ed0e5f964d73aa1571c49dacaade, entries=48, sequenceid=131, filesize=10.3 K 2023-07-11 20:15:23,525 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/.tmp/rep_barrier/ebec1c1d0aa243cf997fe6d2162e1c14 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/rep_barrier/ebec1c1d0aa243cf997fe6d2162e1c14 2023-07-11 20:15:23,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebec1c1d0aa243cf997fe6d2162e1c14 2023-07-11 20:15:23,532 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/rep_barrier/ebec1c1d0aa243cf997fe6d2162e1c14, entries=13, sequenceid=131, filesize=6.4 K 2023-07-11 20:15:23,533 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/.tmp/table/55105c25364b43319b40f26ed2a1ded3 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/table/55105c25364b43319b40f26ed2a1ded3 2023-07-11 20:15:23,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55105c25364b43319b40f26ed2a1ded3 2023-07-11 20:15:23,538 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/table/55105c25364b43319b40f26ed2a1ded3, entries=24, sequenceid=131, filesize=6.9 K 2023-07-11 20:15:23,540 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 238ms, sequenceid=131, compaction requested=false 2023-07-11 20:15:23,543 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:23,543 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:40513-0x101560426f70001, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:23,543 INFO [RS:0;jenkins-hbase4:40513] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40513,1689106361915; zookeeper connection closed. 2023-07-11 20:15:23,550 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7cc4e542] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7cc4e542 2023-07-11 20:15:23,557 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-11 20:15:23,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-11 20:15:23,558 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-11 20:15:23,559 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-11 20:15:23,559 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-11 20:15:23,559 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-11 20:15:23,602 DEBUG [RS:2;jenkins-hbase4:43979] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs 2023-07-11 20:15:23,602 INFO [RS:2;jenkins-hbase4:43979] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43979%2C1689106362092:(num 1689106364251) 2023-07-11 20:15:23,602 DEBUG [RS:2;jenkins-hbase4:43979] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,602 INFO [RS:2;jenkins-hbase4:43979] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:23,602 INFO [RS:2;jenkins-hbase4:43979] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 20:15:23,603 INFO [RS:2;jenkins-hbase4:43979] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-11 20:15:23,603 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:23,603 INFO [RS:2;jenkins-hbase4:43979] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-11 20:15:23,603 INFO [RS:2;jenkins-hbase4:43979] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-11 20:15:23,604 INFO [RS:2;jenkins-hbase4:43979] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43979 2023-07-11 20:15:23,611 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:23,611 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:15:23,611 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43979,1689106362092 2023-07-11 20:15:23,612 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43979,1689106362092] 2023-07-11 20:15:23,612 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43979,1689106362092; numProcessing=2 2023-07-11 20:15:23,614 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43979,1689106362092 already deleted, retry=false 2023-07-11 20:15:23,614 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43979,1689106362092 expired; onlineServers=1 2023-07-11 20:15:23,695 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,46707,1689106362013; all regions closed. 2023-07-11 20:15:23,712 DEBUG [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs 2023-07-11 20:15:23,712 INFO [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46707%2C1689106362013.meta:.meta(num 1689106364478) 2023-07-11 20:15:23,713 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:23,713 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:43979-0x101560426f70003, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:23,713 INFO [RS:2;jenkins-hbase4:43979] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43979,1689106362092; zookeeper connection closed. 2023-07-11 20:15:23,720 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@319ded7f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@319ded7f 2023-07-11 20:15:23,747 DEBUG [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/oldWALs 2023-07-11 20:15:23,747 INFO [RS:1;jenkins-hbase4:46707] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46707%2C1689106362013:(num 1689106364251) 2023-07-11 20:15:23,747 DEBUG [RS:1;jenkins-hbase4:46707] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,747 INFO [RS:1;jenkins-hbase4:46707] regionserver.LeaseManager(133): Closed leases 2023-07-11 20:15:23,748 INFO [RS:1;jenkins-hbase4:46707] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-11 20:15:23,748 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:23,749 INFO [RS:1;jenkins-hbase4:46707] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46707 2023-07-11 20:15:23,750 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46707,1689106362013 2023-07-11 20:15:23,750 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-11 20:15:23,754 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46707,1689106362013] 2023-07-11 20:15:23,754 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46707,1689106362013; numProcessing=3 2023-07-11 20:15:23,755 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46707,1689106362013 already deleted, retry=false 2023-07-11 20:15:23,755 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,46707,1689106362013 expired; onlineServers=0 2023-07-11 20:15:23,755 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36627,1689106360268' ***** 2023-07-11 20:15:23,755 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-11 20:15:23,756 DEBUG [M:0;jenkins-hbase4:36627] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@498ccd7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-11 20:15:23,756 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36627,1689106360268 2023-07-11 20:15:23,756 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36627,1689106360268; all regions closed. 2023-07-11 20:15:23,756 DEBUG [M:0;jenkins-hbase4:36627] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-11 20:15:23,756 DEBUG [M:0;jenkins-hbase4:36627] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-11 20:15:23,756 DEBUG [M:0;jenkins-hbase4:36627] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-11 20:15:23,756 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-11 20:15:23,756 INFO [M:0;jenkins-hbase4:36627] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-11 20:15:23,756 INFO [M:0;jenkins-hbase4:36627] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-11 20:15:23,756 INFO [M:0;jenkins-hbase4:36627] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-11 20:15:23,757 DEBUG [M:0;jenkins-hbase4:36627] master.HMaster(1512): Stopping service threads 2023-07-11 20:15:23,757 INFO [M:0;jenkins-hbase4:36627] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-11 20:15:23,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689106363689] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689106363689,5,FailOnTimeoutGroup] 2023-07-11 20:15:23,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689106363692] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689106363692,5,FailOnTimeoutGroup] 2023-07-11 20:15:23,758 ERROR [M:0;jenkins-hbase4:36627] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-11 20:15:23,758 INFO [M:0;jenkins-hbase4:36627] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-11 20:15:23,758 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-11 20:15:23,759 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-11 20:15:23,759 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-11 20:15:23,764 DEBUG [M:0;jenkins-hbase4:36627] zookeeper.ZKUtil(398): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-11 20:15:23,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-11 20:15:23,764 WARN [M:0;jenkins-hbase4:36627] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-11 20:15:23,764 INFO [M:0;jenkins-hbase4:36627] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-11 20:15:23,765 INFO [M:0;jenkins-hbase4:36627] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-11 20:15:23,766 DEBUG [M:0;jenkins-hbase4:36627] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-11 20:15:23,766 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:23,766 DEBUG [M:0;jenkins-hbase4:36627] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:23,766 DEBUG [M:0;jenkins-hbase4:36627] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-11 20:15:23,766 DEBUG [M:0;jenkins-hbase4:36627] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:23,766 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=451.94 KB 2023-07-11 20:15:23,854 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:23,854 INFO [RS:1;jenkins-hbase4:46707] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,46707,1689106362013; zookeeper connection closed. 2023-07-11 20:15:23,854 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): regionserver:46707-0x101560426f70002, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:23,863 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@680da514] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@680da514 2023-07-11 20:15:23,863 INFO [Listener at jenkins-hbase4.apache.org/34985] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-11 20:15:23,866 INFO [M:0;jenkins-hbase4:36627] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8c32d7ddbdee48a184ca99544a642eb3 2023-07-11 20:15:23,870 INFO [M:0;jenkins-hbase4:36627] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c32d7ddbdee48a184ca99544a642eb3 2023-07-11 20:15:23,871 DEBUG [M:0;jenkins-hbase4:36627] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8c32d7ddbdee48a184ca99544a642eb3 as hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8c32d7ddbdee48a184ca99544a642eb3 2023-07-11 20:15:23,876 INFO [M:0;jenkins-hbase4:36627] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8c32d7ddbdee48a184ca99544a642eb3 2023-07-11 20:15:23,876 INFO [M:0;jenkins-hbase4:36627] regionserver.HStore(1080): Added hdfs://localhost:44579/user/jenkins/test-data/91dd6545-91fc-c061-7e59-1b063880bc63/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8c32d7ddbdee48a184ca99544a642eb3, entries=119, sequenceid=899, filesize=28.6 K 2023-07-11 20:15:23,880 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384683, heapSize ~451.92 KB/462768, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 114ms, sequenceid=899, compaction requested=false 2023-07-11 20:15:23,882 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-11 20:15:23,882 DEBUG [M:0;jenkins-hbase4:36627] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-11 20:15:23,899 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-11 20:15:23,899 INFO [M:0;jenkins-hbase4:36627] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-11 20:15:23,900 INFO [M:0;jenkins-hbase4:36627] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36627 2023-07-11 20:15:23,902 DEBUG [M:0;jenkins-hbase4:36627] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36627,1689106360268 already deleted, retry=false 2023-07-11 20:15:24,005 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:24,006 INFO [M:0;jenkins-hbase4:36627] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36627,1689106360268; zookeeper connection closed. 2023-07-11 20:15:24,006 DEBUG [Listener at localhost/39111-EventThread] zookeeper.ZKWatcher(600): master:36627-0x101560426f70000, quorum=127.0.0.1:53621, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-11 20:15:24,008 WARN [Listener at jenkins-hbase4.apache.org/34985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:15:24,021 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:24,127 WARN [BP-1585325277-172.31.14.131-1689106356113 heartbeating to localhost/127.0.0.1:44579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:15:24,127 WARN [BP-1585325277-172.31.14.131-1689106356113 heartbeating to localhost/127.0.0.1:44579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1585325277-172.31.14.131-1689106356113 (Datanode Uuid bfc2094f-80a9-4f11-b272-58e939c2b448) service to localhost/127.0.0.1:44579 2023-07-11 20:15:24,130 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data5/current/BP-1585325277-172.31.14.131-1689106356113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:24,130 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data6/current/BP-1585325277-172.31.14.131-1689106356113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:24,132 WARN [Listener at jenkins-hbase4.apache.org/34985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:15:24,148 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:24,153 WARN [BP-1585325277-172.31.14.131-1689106356113 heartbeating to localhost/127.0.0.1:44579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:15:24,153 WARN [BP-1585325277-172.31.14.131-1689106356113 heartbeating to localhost/127.0.0.1:44579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1585325277-172.31.14.131-1689106356113 (Datanode Uuid 693cf224-9e0e-4942-94de-4e07b29ca66e) service to localhost/127.0.0.1:44579 2023-07-11 20:15:24,154 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data3/current/BP-1585325277-172.31.14.131-1689106356113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:24,154 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data4/current/BP-1585325277-172.31.14.131-1689106356113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:24,156 WARN [Listener at jenkins-hbase4.apache.org/34985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-11 20:15:24,168 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:24,271 WARN [BP-1585325277-172.31.14.131-1689106356113 heartbeating to localhost/127.0.0.1:44579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-11 20:15:24,272 WARN [BP-1585325277-172.31.14.131-1689106356113 heartbeating to localhost/127.0.0.1:44579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1585325277-172.31.14.131-1689106356113 (Datanode Uuid 8bdf6493-1666-4b4e-9182-078f2e2d5a4a) service to localhost/127.0.0.1:44579 2023-07-11 20:15:24,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data1/current/BP-1585325277-172.31.14.131-1689106356113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:24,273 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/f1ccb855-ffaf-087a-e77a-727ca3fb7bdc/cluster_c98def6f-e8bf-28de-2fba-f23a5099874b/dfs/data/data2/current/BP-1585325277-172.31.14.131-1689106356113] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-11 20:15:24,310 INFO [Listener at jenkins-hbase4.apache.org/34985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-11 20:15:24,449 INFO [Listener at jenkins-hbase4.apache.org/34985] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-11 20:15:24,596 INFO [Listener at jenkins-hbase4.apache.org/34985] hbase.HBaseTestingUtility(1293): Minicluster is down